The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
A Comprehensive Study on Cross-View Gait Based Human Identification with Deep CNNs
Abstract
This paper studies an approach to gait based human identification via similarity learning by deep convolutional neural networks (CNNs). With a pretty small group of labeled multi-view human walking videos, we can train deep networks to recognize the most discriminative changes of gait patterns which suggest the change of human identity. To the best of our knowledge, this is the first work based on deep CNNs for gait recognition in the literature. Here, we provide an extensive empirical evaluation in terms of various scenarios, namely, cross-view and cross-walking-condition, with different preprocessing approaches and network architectures. The method is first evaluated on the challenging CASIA-B dataset in terms of cross-view gait recognition. Experimental results show that it outperforms the previous state-of-the-art methods by a significant margin. In particular, our method shows advantages when the cross-view angle is large, i.e., no less than 36 degree. And the average recognition rate can reach 94 percent, much better than the previous best result (less than 65 percent). The method is further evaluated on the OU-ISIR gait dataset to test its generalization ability to larger data. OU-ISIR is currently the largest dataset available in the literature for gait recognition, with 4,007 subjects. On this dataset, the average accuracy of our method under identical view conditions is above 98 percent, and the one for cross-view scenarios is above 91 percent. Finally, the method also performs the best on the USF gait dataset, whose gait sequences are imaged in a real outdoor scene. These results show great potential of this method for practical applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
(2010) · International Conference on Machine Learning · Cited by 13,995
Bidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Two-Stream Convolutional Networks for Action Recognition in Videos
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,235
Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,445
Learning a Similarity Metric Discriminatively, with Application to Face Verification
Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036
(1989) · neural information processing systems · Cited by 3,736
Action Recognition with Improved Trajectories
Wang, H., & Schmid, C. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.441 · Cited by 3,407
DeepPose: Human Pose Estimation via Deep Neural Networks
Toshev, A., & Szegedy, C. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.214 · Cited by 3,185
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680
Learning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
Convolutional networks and applications in vision
LeCun, Y., Kavukcuoglu, K., & Farabet, C. (2010) · Proceedings of 2010 IEEE International Symposium on Circuits and Systems · doi:10.1109/iscas.2010.5537907 · Cited by 2,213
Deep Learning Face Representation from Predicting 10,000 Classes
Sun, Y., Wang, X., & Tang, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.244 · Cited by 1,997
Self-citationIndividual recognition using gait energy image
Han, J., & Bhanu, B. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.38 · Cited by 1,847
The humanID gait challenge problem: data sets, performance, and analysis
Sarkar, S., Phillips, P. J., Liu, Z., Vega, I. R., Grother, P., & Bowyer, K. W. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.39 · Cited by 1,133
Yu, S., Tan, D., & Tan, T. (2006) · 18th International Conference on Pattern Recognition (ICPR'06) · doi:10.1109/icpr.2006.67 · Cited by 1,056
Self-citationFree viewpoint action recognition using motion history volumes
Weinland, D., Ronfard, R., & Boyer, E. (2006) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.07.013 · Cited by 896
Differential Recurrent Neural Networks for Action Recognition
Veeriah, V., Zhuang, N., & Qi, G.-J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.460 · Cited by 516
Gait Recognition Using a View Transformation Model in the Frequency Domain
Makihara, Y., Sagawa, R., Mukaigawa, Y., Echigo, T., & Yagi, Y. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744078_12 · Cited by 392
Iwama, H., Okumura, M., Makihara, Y., & Yagi, Y. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2204253 · Cited by 391
Toward Accurate and Fast Iris Segmentation for Iris Biometrics
He, Z., Tan, T., Sun, Z., & Qiu, X. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.183 · Cited by 376
Self-citationConvolutional Channel Features
Yang, B., Yan, J., Lei, Z., & Li, S. Z. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.18 · Cited by 301
Hybrid Deep Learning for Face Verification
Sun, Y., Wang, X., & Tang, X. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.188 · Cited by 285
Self-citationGait flow image: A silhouette-based gait representation for human identification
Lam, T. H. W., Cheung, K. H., & Liu, J. N. K. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2010.10.011 · Cited by 269
On Using Gait in Forensic Biometrics
Bouchrika, I., Goffredo, M., Carter, J., & Nixon, M. (2011) · Journal of Forensic Sciences · doi:10.1111/j.1556-4029.2011.01793.x · Cited by 243
Self-Calibrating View-Invariant Gait Biometrics
Goffredo, M., Bouchrika, I., Carter, J. N., & Nixon, M. S. (2010) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2009.2031091 · Cited by 204
3D Gait Recognition Using Multiple Cameras
Zhao, G., Liu, G., Li, H., & Pietikainen, M. (2006) · 7th International Conference on Automatic Face and Gesture Recognition (FGR06) · doi:10.1109/fgr.2006.2 · Cited by 197
Learning to Recognize Activities from the Wrong View Point
Farhadi, A., & Tabrizi, M. K. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88682-2_13 · Cited by 194
Multiple views gait recognition using View Transformation Model based on optimized Gait Energy Image
Kusakunniran, W., Wu, Q., Li, H., & Zhang, J. (2009) · 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops · doi:10.1109/iccvw.2009.5457587 · Cited by 194
Support vector regression for multi-view gait recognition based on local motion feature selection
Kusakunniran, W., Wu, Q., Zhang, J., & Li, H. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540113 · Cited by 163
Gait Recognition Under Various Viewing Angles Based on Correlated Motion Regression
Kusakunniran, W., Wu, Q., Zhang, J., & Li, H. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2186744 · Cited by 157
Gait Analysis in Forensic Medicine*
Larsen, P. K., Simonsen, E. B., & Lynnerup, N. (2008) · Journal of Forensic Sciences · doi:10.1111/j.1556-4029.2008.00807.x · Cited by 157
Chrono-Gait Image: A Novel Temporal Template for Gait Recognition
Wang, C., Zhang, J., Pu, J., Yuan, X., & Wang, L. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15549-9_19 · Cited by 152
Self-citationView-Invariant Discriminative Projection for Multi-View Gait-Based Human Identification
Hu, M., Wang, Y., Zhang, Z., Little, J. J., & Huang, D. (2013) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2013.2287605 · Cited by 133
A Database for Person Re-Identification in Multi-Camera Surveillance Networks
Bialkowski, A., Denman, S., Sridharan, S., Fookes, C., & Lucey, P. (2012) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta.2012.6411689 · Cited by 129
Model-based 3D gait biometrics
Ariyanto, G., & Nixon, M. S. (2011) · doi:10.1109/ijcb.2011.6117582 · Cited by 129
View-independent human motion classification using image-based reconstruction
Bodor, R., Drenner, A., Fehr, D., Masoud, O., & Papanikolopoulos, N. (2008) · Image and Vision Computing · doi:10.1016/j.imavis.2008.11.008 · Cited by 123
Recognizing Gaits Across Views Through Correlated Motion Co-Clustering
Kusakunniran, W., Wu, Q., Zhang, J., Li, H., & Wang, L. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2294552 · Cited by 117
Self-citationCross View Gait Recognition Using Correlation Strength
Bashir, K., Xiang, T., & Gong, S. (2010) · British Machine Vision Conference (BMVC) · doi:10.5244/c.24.109 · Cited by 115
Face recognition by sparse discriminant analysis via joint L2,1-norm minimization
Shi, X., Yang, Y., Guo, Z., & Lai, Z. (2014) · Pattern Recognition · doi:10.1016/j.patcog.2014.01.007 · Cited by 114
Human Gait Recognition via Sparse Discriminant Projection Learning
Lai, Z., Xu, Y. J., Jin, Z., & Zhang, D. D. (2014) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2014.2305495 · Cited by 103
A New View-Invariant Feature for Cross-View Gait Recognition
Kusakunniran, W., Wu, Q., Zhang, J., Ma, Y., & Li, H. (2013) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2013.2252342 · Cited by 98
Robust human action recognition via long short-term memory
Grushin, A., Monner, D. D., Reggia, J. A., & Mishra, A. (2013) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2013.6706797 · Cited by 83
Hu, H. (2013) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2013.2242640 · Cited by 81
Uncooperative gait recognition by learning to rank
Martín-Félez, R., & Xiang, T. (2014) · Pattern Recognition · doi:10.1016/j.patcog.2014.06.010 · Cited by 63
Early Hierarchical Contexts Learned by Convolutional Networks for Image Segmentation
Wu, Z., Huang, Y., Yu, Y., Wang, L., & Tan, T. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.273 · Cited by 46
Self-citationHybrid Dynamical Models of Human Motion for the Recognition of Human Gaits
Bissacco, A., & Soatto, S. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-009-0248-7 · Cited by 29
Convolutional Channel Features: Tailoring CNN to Diverse TasksPreprint
Yang, B., Yan, J., Lei, Z., & Li, S. Z. (2015) · arXiv (Cornell University) · Cited by 2
Cited by
GaitSet: Regarding Gait as a Set for Cross-View Gait Recognition
Chao, H., He, Y., Zhang, J., & Feng, J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018126 · Cited by 659
GaitPart: Temporal Part-Based Model for Gait Recognition
Fan, C., Peng, Y., Cao, C., Liu, X., Hou, S., Chi, J., Huang, Y., Li, Q., & He, Z. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01423 · Cited by 584
Self-citationTakemura, N., Makihara, Y., Muramatsu, D., Echigo, T., & Yagi, Y. (2018) · IPSJ Transactions on Computer Vision and Applications · doi:10.1186/s41074-018-0039-6 · Cited by 451
Deep Representation Learning With Part Loss for Person Re-Identification
Yao, H., Zhang, S., Hong, R., Zhang, Y., Xu, C., & Tian, Q. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2891888 · Cited by 439
Gait Recognition via Effective Global-Local Feature Representation and Local Temporal Aggregation
Lin, B., Zhang, S., & Yu, X. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01438 · Cited by 334
Metadata
- Authors
- Wu, Z., Huang, Y., Wang, L., Wang, X., & Tan, T.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2017-02-01
- Volume
- 39
- Issue
- 2
- Pages
- 209-226
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2322772590
- Cited by
- 729
- References
- 57
- FWCI
- 24.01
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.