The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Gait Recognition in the Wild with Dense 3D Representations and A Benchmark
Open accessAbstract
Existing studies for gait recognition are dominated by 2D representations like the silhouette or skeleton of the human body in constrained scenes. However, humans live and walk in the unconstrained 3D space, so projecting the 3D human body onto the 2D plane will discard a lot of crucial information like the viewpoint, shape, and dynamics for gait recognition. Therefore, this paper aims to explore dense 3D representations for gait recognition in the wild, which is a practical yet neglected problem. In particular, we propose a novel framework to explore the 3D Skinned Multi-Person Linear (SMPL) model of the human body for gait recognition, named SMPLGait. Our framework has two elaborately-designed branches of which one extracts appearance features from silhouettes, the other learns knowledge of 3D viewpoints and shapes from the 3D SMPL model. In addition, due to the lack of suitable datasets, we build the first large-scale 3D representation-based gait recognition dataset, named Gait3D. It contains 4,000 subjects and over 25,000 sequences extracted from 39 cameras in an unconstrained indoor scene. More importantly, it provides 3D SMPL models recovered from video frames which can provide dense 3D information of body shape, viewpoint, and dynamics. Based on Gait3D, we comprehensively compare our method with existing gait recognition approaches, which reflects the superior performance of our framework and the potential of 3D representations for gait recognition in the wild. The code and dataset are available at: https://gait3d.github.io.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
(1996) · Cited by 20,179
OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E., & Sheikh, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2929257 · Cited by 5,536
Deep High-Resolution Representation Learning for Visual Recognition
Wang, J., Sun, K., Cheng, T., Jiang, B., Deng, C., Zhao, Y., Liu, D., Mu, Y., Tan, M., Wang, X., et al. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2983686 · Cited by 4,894
Self-citationScalable Person Re-identification: A Benchmark
Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., & Tian, Q. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.133 · Cited by 4,506
Loper, M., Mahmood, N., Romero, J., Pons-Moll, G., & J, B. M. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818013 · Cited by 3,734
In Defense of the Triplet Loss for Person Re-Identification
Hermans, A., Beyer, L., & Leibe, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07737 · Cited by 2,687
Deep Learning for Person Re-Identification: A Survey and Outlook
Ye, M., Shen, J., Lin, G., Xiang, T., Shao, L., & Hoi, S. C. H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3054775 · Cited by 2,259
End-to-End Recovery of Human Shape and Pose
Kanazawa, A., Black, M. J., Jacobs, D. W., & Malik, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00744 · Cited by 1,870
Individual recognition using gait energy image
Han, J., & Bhanu, B. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.38 · Cited by 1,847
NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understanding
Liu, J., Shahroudy, A., Perez, M., Wang, G., Duan, L.-Y., & Kot, A. C. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2916873 · Cited by 1,818
SCAPE: shape completion and animation of people
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., & Davis, J. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073207 · Cited by 1,489
Silhouette analysis-based gait recognition for human identification
Wang, L., Tan, T., Ning, H., & Hu, W. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1251144 · Cited by 1,202
The humanID gait challenge problem: data sets, performance, and analysis
Sarkar, S., Phillips, P. J., Liu, Z., Vega, I. R., Grother, P., & Bowyer, K. W. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.39 · Cited by 1,133
Yu, S., Tan, D., & Tan, T. (2006) · 18th International Conference on Pattern Recognition (ICPR'06) · doi:10.1109/icpr.2006.67 · Cited by 1,056
VIBE: Video Inference for Human Body Pose and Shape Estimation
Kocabas, M., Athanasiou, N., & Black, M. J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00530 · Cited by 1,031
A Comprehensive Study on Cross-View Gait Based Human Identification with Deep CNNs
Wu, Z., Huang, Y., Wang, L., Wang, X., & Tan, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2545669 · Cited by 729
GaitSet: Regarding Gait as a Set for Cross-View Gait Recognition
Chao, H., He, Y., Zhang, J., & Feng, J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018126 · Cited by 659
GaitPart: Temporal Part-Based Model for Gait Recognition
Fan, C., Peng, Y., Cao, C., Liu, X., Hou, S., Chi, J., Huang, Y., Li, Q., & He, Z. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01423 · Cited by 584
Self-citationAnalyzing and recognizing walking figures in XYT
Niyogi, & Adelson (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323868 · Cited by 572
3D Human Pose Estimation = 2D Pose Estimation + Matching
Chen, C.-H., & Ramanan, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.610 · Cited by 566
Large-scale vehicle re-identification in urban surveillance videos
Liu, X., Liu, W., Ma, H., & Fu, H. (2016) · 2016 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2016.7553002 · Cited by 513
Self-citationA model-based gait recognition method with body pose and human prior knowledge
Liao, R., Yu, S., An, W., & Huang, Y. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2019.107069 · Cited by 509
Deep Multi-View Enhancement Hashing for Image Retrieval
Yan, C., Gong, B., Wei, Y., & Gao, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2975798 · Cited by 504
Self-citationGEINet: View-invariant gait recognition using a convolutional neural network
Shiraga, K., Makihara, Y., Muramatsu, D., Echigo, T., & Yagi, Y. (2016) · 2016 International Conference on Biometrics (ICB) · doi:10.1109/icb.2016.7550060 · Cited by 468
Takemura, N., Makihara, Y., Muramatsu, D., Echigo, T., & Yagi, Y. (2018) · IPSJ Transactions on Computer Vision and Applications · doi:10.1186/s41074-018-0039-6 · Cited by 451
PROVID: Progressive and Multimodal Vehicle Reidentification for Large-Scale Urban Surveillance
Liu, X., Liu, W., Mei, T., & Ma, H. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2751966 · Cited by 444
Self-citationIwama, H., Okumura, M., Makihara, Y., & Yagi, Y. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2204253 · Cited by 391
Task-Adaptive Attention for Image Captioning
Yan, C., Hao, Y., Li, L., Yin, J., Liu, A., Mao, Z., Chen, Z., & Gao, X. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3067449 · Cited by 367
Self-citationFastReID: A Pytorch Toolbox for General Instance Re-identification
He, L., Liao, X., Liu, W., Liu, X., Cheng, P., & Mei, T. (2023) · Proceedings of the 31st ACM International Conference on Multimedia · doi:10.1145/3581783.3613460 · Cited by 364
Self-citationAutomated person recognition by walking and running via model-based approaches
Yam, C., Nixon, M. S., & Carter, J. N. (2004) · Pattern Recognition · doi:10.1016/j.patcog.2003.09.012 · Cited by 353
Song, Y.-F., Zhang, Z., Shan, C., & Wang, L. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413802 · Cited by 350
Gait Recognition via Effective Global-Local Feature Representation and Local Temporal Aggregation
Lin, B., Zhang, S., & Yu, X. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01438 · Cited by 334
Gaitgraph: Graph Convolutional Network for Skeleton-Based Gait Recognition
Teepe, T., Khan, A., Gilg, J., Herzog, F., Hormann, S., & Rigoll, G. (2021) · 2021 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip42928.2021.9506717 · Cited by 323
(2019) · ACM Computing Surveys · doi:10.1145/3230633 · Cited by 303
Depth Image Denoising Using Nuclear Norm and Learning Graph Model
Yan, C., Li, Z., Zhang, Y., Liu, Y., Ji, X., & Zhang, Y. (2020) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3404374 · Cited by 289
Self-citationGait Recognition via Disentangled Representation Learning
Zhang, Z., Tran, L., Yin, X., Atoum, Y., Liu, X., Wan, J., & Wang, N. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00484 · Cited by 288
Self-citationMonocular, One-stage, Regression of Multiple 3D People
Sun, Y., Bao, Q., Liu, W., Fu, Y., Black, M. J., & Mei, T. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01099 · Cited by 254
Self-citationGait Recognition in the Wild: A Benchmark
(2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01452 · Cited by 253
Recent Advances of Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspective
Liu, W., Bao, Q., Sun, Y., & Mei, T. (2023) · ACM Computing Surveys · doi:10.1145/3524497 · Cited by 247
Self-citationAge-Invariant Face Recognition by Multi-Feature Fusionand Decomposition with Self-attention
Yan, C., Meng, L., Li, L., Zhang, J., Wang, Z., Yin, J., Zhang, J., Sun, Y., & Zheng, B. (2022) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3472810 · Cited by 238
Self-citationGait Lateral Network: Learning Discriminative and Compact Representations for Gait Recognition
Hou, S., Cao, C., Liu, X., & Huang, Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_22 · Cited by 219
Self-citation3D Gait Recognition Using Multiple Cameras
Zhao, G., Liu, G., Li, H., & Pietikainen, M. (2006) · 7th International Conference on Automatic Face and Gesture Recognition (FGR06) · doi:10.1109/fgr.2006.2 · Cited by 197
Context-Sensitive Temporal Feature Learning for Gait Recognition
Huang, X., Zhu, D., Wang, H., Wang, X., Yang, B., He, B., Liu, W., & Feng, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01267 · Cited by 190
Self-citationAn, W., Yu, S., Makihara, Y., Wu, X., Xu, C., Yu, Y., Liao, R., & Yagi, Y. (2020) · IEEE Transactions on Biometrics, Behavior, and Identity Science · doi:10.1109/tbiom.2020.3008862 · Cited by 183
Precise No-Reference Image Quality Evaluation Based on Distortion Identification
Yan, C., Teng, T., Liu, Y., Zhang, Y., Wang, H., & Ji, X. (2021) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3468872 · Cited by 183
Self-citationAltab Hossain, M., Makihara, Y., Wang, J., & Yagi, Y. (2010) · Pattern Recognition · doi:10.1016/j.patcog.2009.12.020 · Cited by 173
Putting People in their Place: Monocular Regression of 3D People in Depth
Sun, Y., Liu, W., Bao, Q., Fu, Y., Mei, T., & Black, M. J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01289 · Cited by 166
Self-citationEfficient Night Gait Recognition Based on Template Matching
Tan, D., Huang, K., Yu, S., & Tan, T. (2006) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2006.478 · Cited by 162
3D tracking for gait characterization and recognition
Urtasun, R., & Fua, P. (2004) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2004.1301503 · Cited by 148
Model-based 3D gait biometrics
Ariyanto, G., & Nixon, M. S. (2011) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb.2011.6117582 · Cited by 132
Gait Analysis of Gender and Age Using a Large-Scale Multi-view Gait Database
Makihara, Y., Mannami, H., & Yagi, Y. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-19309-5_34 · Cited by 107
Silhouette transformation based on walking speed for gait identification
Tsuji, A., Makihara, Y., & Yagi, Y. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540144 · Cited by 98
Xu, C., Makihara, Y., Ogi, G., Li, X., Yagi, Y., & Lu, J. (2017) · IPSJ Transactions on Computer Vision and Applications · doi:10.1186/s41074-017-0035-2 · Cited by 88
Uddin, M. Z., Ngo, T. T., Makihara, Y., Takemura, N., Li, X., Muramatsu, D., & Yagi, Y. (2018) · IPSJ Transactions on Computer Vision and Applications · doi:10.1186/s41074-018-0041-z · Cited by 79
Cross-View Gait Recognition with Deep Universal Linear Embeddings
Zhang, S., Wang, Y., & Li, A. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00898 · Cited by 60
Unsupervised Domain Adaptation for 3D Keypoint Estimation via View Consistency
Zhou, X., Karpur, A., Gan, C., Luo, L., & Huang, Q. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01258-8_9 · Cited by 42
Recognition of walking humans in 3D: Initial results
Yamauchi, K., Bhanu, B., & Saitô, H. (2009) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2009.5204296 · Cited by 27
AutoGPart: Intermediate Supervision Search for Generalizable 3D Part Segmentation
Liu, X., Xu, X., Rao, A., Gan, C., & Yi, L. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01133 · Cited by 19
Self-citation
Cited by
OpenGait: Revisiting Gait Recognition Toward Better Practicality
Fan, C., Liang, J., Shen, C., Hou, S., Huang, Y., & Yu, S. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00936 · Cited by 260
Metadata
- Authors
- Zheng, J., Liu, X., Liu, W., He, L., Yan, C., & Mei, T.
- Venue
- 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2022-06
- Pages
- 20196-20205
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4312652114
- Cited by
- 260
- References
- 59
- FWCI
- 115.07
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.