The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Human Gait Recognition Based on Frame-by-Frame Gait Energy Images and Convolutional Long Short-Term Memory
Open accessAbstract
Human gait recognition is one of the most promising biometric technologies, especially for unobtrusive video surveillance and human identification from a distance. Aiming at improving recognition rate, in this paper we study gait recognition using deep learning and propose a novel method based on convolutional Long Short-Term Memory (Conv-LSTM). First, we present a variation of Gait Energy Images, i.e. frame-by-frame GEI (ff-GEI), to expand the volume of available Gait Energy Images (GEI) data and relax the constraints of gait cycle segmentation required by existing gait recognition methods. Second, we demonstrate the effectiveness of ff-GEI by analyzing the cross-covariance of one person’s gait data. Then, making use of the temporality of our human gait, we design a novel gait recognition model using Conv-LSTM. Finally, the proposed method is evaluated extensively based on the CASIA Dataset B for cross-view gait recognition, furthermore the OU-ISIR Large Population Dataset is employed to verify its generalization ability. Our experimental results show that the proposed method outperforms other algorithms based on these two datasets. The results indicate that the proposed ff-GEI model using Conv-LSTM, coupled with the new gait representation, can effectively solve the problems related to cross-view gait recognition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Concerning Recurrent Neural Networks [43], Wang and Yan [115] used the Long short-term memory [32], a popular RNN architecture capable of learning long-term dependencies, for crossview human gait recognition based on frame-by-frame GEIs. Experiments conducted over CASIA B [128] and OU-ISIR [59] Large Population datasets demonstrate the model's robustness over several baselines.”
From Gait Recognition Based on Deep Learning: A Survey (2023) · cites this paper as [115]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Individual recognition using gait energy image
Han, J., & Bhanu, B. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.38 · Cited by 1,873
General Tensor Discriminant Analysis and Gabor Features for Gait Recognition
Tao, D., Li, X., Wu, X., & Maybank, S. J. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1096 · Cited by 1,140
The humanID gait challenge problem: data sets, performance, and analysis
Sarkar, S., Phillips, P. J., Liu, Z., Vega, I. R., Grother, P., & Bowyer, K. W. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.39 · Cited by 1,133
A Comprehensive Study on Cross-View Gait Based Human Identification with Deep CNNs
Wu, Z., Huang, Y., Wang, L., Wang, X., & Tan, T. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2545669 · Cited by 741
Self-citationLi, S., Zhao, X., & Zhou, G. (2019) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12433 · Cited by 500
GEINet: View-invariant gait recognition using a convolutional neural network
Shiraga, K., Makihara, Y., Muramatsu, D., Echigo, T., & Yagi, Y. (2016) · 2016 International Conference on Biometrics (ICB) · doi:10.1109/icb.2016.7550060 · Cited by 468
Encoder–decoder network for pixel-level road crack detection in black-box images
Bang, S., Park, S., Kim, H., & Kim, H. (2019) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12440 · Cited by 429
Liang, X. P. (2018) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12425 · Cited by 406
Rafiei, M. H., & Adeli, H. (2017) · Engineering Structures · doi:10.1016/j.engstruct.2017.10.070 · Cited by 404
Iwama, H., Okumura, M., Makihara, Y., & Yagi, Y. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2204253 · Cited by 394
Gait Recognition Using a View Transformation Model in the Frequency Domain
Makihara, Y., Sagawa, R., Mukaigawa, Y., Echigo, T., & Yagi, Y. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744078_12 · Cited by 392
A novel machine learning‐based algorithm to detect damage in high‐rise building structures
Rafiei, M. H., & Adeli, H. (2017) · The Structural Design of Tall and Special Buildings · doi:10.1002/tal.1400 · Cited by 348
Rafiei, M. H., & Adeli, H. (2018) · Journal of Construction Engineering and Management · doi:10.1061/(asce)co.1943-7862.0001570 · Cited by 288
Supervised Deep Restricted Boltzmann Machine for Estimation of Concrete
Rafiei, M. H., Khushefati, W. H., Demirboğa, R., & Adeli, H. (2017) · ACI Materials Journal · doi:10.14359/51689560 · Cited by 280
Multi-view gait recognition using 3D convolutional neural networks
Wolf, T., Babaee, M., & Rigoll, G. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7533144 · Cited by 241
Self-Calibrating View-Invariant Gait Biometrics
Goffredo, M., Bouchrika, I., Carter, J. N., & Nixon, M. S. (2009) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2009.2031091 · Cited by 204
On Input/Output Architectures for Convolutional Neural Network-Based Cross-View Gait Recognition
Takemura, N., Makihara, Y., Muramatsu, D., Echigo, T., & Yagi, Y. (2017) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2760835 · Cited by 202
3D Gait Recognition Using Multiple Cameras
Zhao, G., Liu, G., Li, H., & Pietikäinen, M. (2006) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fgr.2006.2 · Cited by 197
Multiple views gait recognition using View Transformation Model based on optimized Gait Energy Image
Kusakunniran, W., Wu, Q., Li, H., & Zhang, J. (2009) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2009.5457587 · Cited by 195
The Relation between the ROC Curve and the CMC
Bolle, R. M., Connell, J. H., Pankanti, S., Ratha, N., & Senior, A. (2006) · IEEE Workshop on Automatic Identification Advanced Technologies (AutoID) · doi:10.1109/autoid.2005.48 · Cited by 187
Model-based 3D gait biometrics
Ariyanto, G., & Nixon, M. S. (2011) · doi:10.1109/ijcb.2011.6117582 · Cited by 129
Preconditioned Stochastic Gradient Descent
Li, X.-L. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2672978 · Cited by 129
On Reducing the Effect of Covariate Factors in Gait Recognition: A Classifier Ensemble Method
Guan, Y., Li, C.-T., & Roli, F. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2366766 · Cited by 128
A scalable approach based on deep learning for big data time series forecasting
Torres, J. F., Galicia, A., Troncoso, A., & Alvarez, F. M. (2018) · Integrated Computer-Aided Engineering · doi:10.3233/ica-180580 · Cited by 125
Recognizing Gaits Across Views Through Correlated Motion Co-Clustering
Kusakunniran, W., Wu, Q., Zhang, J., Li, H., & Wang, L. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2294552 · Cited by 119
Luo, X., Li, H., Yang, X., Yu, Y., & Cao, D. (2018) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12419 · Cited by 112
Gait recognition based on dynamic region analysis
Yang, X., Zhou, Y., Zhang, T., Shu, G., & Yang, J. (2008) · Signal Processing · doi:10.1016/j.sigpro.2008.03.006 · Cited by 107
A New View-Invariant Feature for Cross-View Gait Recognition
Kusakunniran, W., Wu, Q., Zhang, J., Ma, Y., & Li, H. (2013) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2013.2252342 · Cited by 98
Wu, R., Singla, A., Jahanshahi, M. R., Bertino, E., Ko, B. J., & Verma, D. C. (2019) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12449 · Cited by 94
Global Convergence of Online BP Training With Dynamic Learning Rate
Zhang, R., Xu, Z., Huang, G.-B., & Wang, D. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2011.2178315 · Cited by 79
Multitask Sparse Bayesian Learning with Applications in Structural Health Monitoring
Huang, Y., Beck, J. L., & Li, H. (2019) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12408 · Cited by 79
Robust Arbitrary-View Gait Recognition Based on 3D Partial Similarity Matching
Tang, J., Luo, J., Tjahjadi, T., & Guo, F. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2612823 · Cited by 71
Gait Recognition With Shifted Energy Image and Structural Feature Extraction
Huang, X., & Boulgouris, N. V. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2180914 · Cited by 67
Regional parallel structure based CNN for thermal infrared face identification
Wang, P., & Bai, X. (2018) · Integrated Computer-Aided Engineering · doi:10.3233/ica-180560 · Cited by 66
End‐to‐End Deep Learning Methodology for Real‐Time Traffic Network Management
Hashemi, H., & Abdelghany, K. F. (2018) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12376 · Cited by 63
Molina‐Cabello, M. A., Luque‐Baena, R. M., López‐Rubio, E., & Thurnhofer‐Hemsi, K. (2018) · Integrated Computer-Aided Engineering · doi:10.3233/ica-180577 · Cited by 62
Gait recognition based on Gabor wavelets and (2D)2PCA
Wang, X., Wang, J., & Yan, K. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-4903-7 · Cited by 55
Self-citationCovariate Conscious Approach for Gait Recognition Based Upon Zernike Moment Invariants
Aggarwal, H., & Vishwakarma, D. K. (2017) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2017.2658674 · Cited by 51
Luo, J., Tang, J., Tjahjadi, T., & Xiao, X. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.05.030 · Cited by 48
Maeda, K., Takahashi, S., Ogawa, T., & Haseyama, M. (2019) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12451 · Cited by 40
A Grassmannian Approach to Address View Change Problem in Gait Recognition
Connie, T., Goh, M. K. O., & Teoh, A. B. J. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2545693 · Cited by 39
Gait Recognition Using HMMs and Dual Discriminative Observations for Sub-Dynamics Analysis
Boulgouris, N. V., & Huang, X. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2266578 · Cited by 32
Schetinin, V., Jakaite, L., & Krzanowski, W. J. (2018) · Integrated Computer-Aided Engineering · doi:10.3233/ica-180567 · Cited by 20
Gait recognition using GEI and pattern trace transform
Theekhanont, P., Kurutach, W., & Miguet, S. (2012) · International Conference on Information Technology in Medicine and Education · doi:10.1109/itime.2012.6291457 · Cited by 11
Learning optimised representations for view-invariant gait recognition
Jia, N., Sánchez, V., & Li, C. (2017) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/btas.2017.8272769 · Cited by 7
Performance analysis of gait recognition with large perspective distortion
Abdulsattar, F. S., & Carter, J. (2016) · IEEE International Conference on Identity, Security and Behavior Analysis (ISBA) · doi:10.1109/isba.2016.7477229 · Cited by 5
Gait recognition using shape trace transform
Theekhanont, P., Miguet, S., & Kurutach, W. (2011) · 2011 IEEE International Symposium on IT in Medicine and Education · doi:10.1109/itime.2011.6132032
Multiresolution fragile watermarking using complex chirp signals for content authentication
Yu, D., Sattar, F., & Barkat, B. (2006) · Pattern Recognition · doi:10.1016/j.patcog.2005.11.023
Research works printed but not linked: 5
- Torres J., 2018, Integr. Comput Aided Eng., 25, 49
- Zhao G., 2006, Int. Conf. Automatic Face and Gesture Recognition, 529
- Jia N., 2017, Int. Joint Conf. Biometrics, 774
- Takemura N., 2018, IEEE Trans. Circ. Syst. Video Technol., 28
- Ko B., 2017, IEEE Int. Conf. Big Data and Smart Computing (BigComp), 358
Cited by
Sorted by citations
Self-Supervised Learning for Electroencephalography
Rafiei, M. H., Gauthier, L. V., Adeli, H., & Takabi, D. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3190448 · Cited by 333
Deep Gait Recognition: A Survey
Sepas‐Moghaddam, A., & Etemad, A. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3151865 · Cited by 344
State of the art in structural health monitoring of offshore and marine structures
Pezeshki, H., Adeli, H., Pavlou, D. G., & Siriwardane, S. C. (2023) · Proceedings of the Institution of Civil Engineers - Maritime Engineering · doi:10.1680/jmaen.2022.027 · Cited by 131
Gait Recognition Based on Deep Learning: A Survey
Filipi Gonçalves dos Santos, C., Oliveira, D. D. S., A. Passos, L., Gonçalves Pires, R., Felipe Silva Santos, D., Pascotti Valem, L., P. Moreira, T., Cleison S. Santana, M., Roder, M., Paulo Papa, J., et al. (2023) · ACM Computing Surveys · doi:10.1145/3490235 · Cited by 108
A Comprehensive Survey on Deep Gait Recognition: Algorithms, Datasets, and Challenges
Shen, C., Yu, S., Wang, J., Huang, G. Q., & Wang, L. (2024) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2024.3486345 · Cited by 112
Metadata
- Authors
- Wang, X., & Yan, W. Q.
- Affiliations
- China Jiliang University (CN)
- Auckland University of Technology (NZ)
- Venue
- International Journal of Neural Systems
- Publisher
- World Scientific Pub Co Pte Ltd
- Published
- 2019-11-21
- Volume
- 30
- Issue
- 01
- Pages
- 1950027
- ISSN
- 0129-0657 (ISSN-L)
- 1793-6462
- OpenAlex
- W2973839564
- Cited by
- 116
- References
- 45
- Citations by year
- 2026: 9 · 2025: 20 · 2024: 16 · 2023: 25 · 2022: 18 · 2021: 17 · 2020: 10 · 2019: 1
- FWCI
- 4.06
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- other-oa
- Locations
- International Journal of Neural Systems (publishedVersion)
- PubMed (publishedVersion)
- Tuwhera (Auckland University of Technology) (submittedVersion, other-oa)
- Funders
- the National Natural Science Foundation of China (61303146, 61602431)
- Topics
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Keywords
- gait recognition, gait energy image, convolutional LSTM, cross-view gait recognition, gait cycle segmentation, biometric identification, video surveillance, CASIA-B
- MeSH terms
- Deep Learning, Adult, Humans, Memory, Short-Term, Models, Biological, Pattern Recognition, Automated, Signal Processing, Computer-Assisted, Neural Networks, Computer, Memory, Long-Term, Datasets as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review