Browse > Article
http://dx.doi.org/10.3745/JIPS.02.0143

Gait Recognition Based on GF-CNN and Metric Learning  

Wen, Junqin (Digital Information Technology Institute, Zhejiang Technical Institute of Economics)
Publication Information
Journal of Information Processing Systems / v.16, no.5, 2020 , pp. 1105-1112 More about this Journal
Abstract
Gait recognition, as a promising biometric, can be used in video-based surveillance and other security systems. However, due to the complexity of leg movement and the difference of external sampling conditions, gait recognition still faces many problems to be addressed. In this paper, an improved convolutional neural network (CNN) based on Gabor filter is therefore proposed to achieve gait recognition. Firstly, a gait feature extraction layer based on Gabor filter is inserted into the traditional CNNs, which is used to extract gait features from gait silhouette images. Then, in the process of gait classification, using the output of CNN as input, we utilize metric learning techniques to calculate distance between two gaits and achieve gait classification by k-nearest neighbors classifiers. Finally, several experiments are conducted on two open-accessed gait datasets and demonstrate that our method reaches state-of-the-art performances in terms of correct recognition rate on the OULP and CASIA-B datasets.
Keywords
Convolutional Neural Network; Gait Recognition; Metric Learning; k-Nearest Neighbors;
Citations & Related Records
연도 인용수 순위
  • Reference
1 R. M. Bolle, J. H. Connell, S. Pankanti, N. K. Ratha, and A. W. Senior, "The relation between the ROC curve and the CMC," in Proceedings of the Fourth IEEE Workshop on Automatic Identification Advanced Technologies (AutoID'05), Buffalo, NY, USA, 2005, pp. 15-20.
2 K. Q. Weinberger and L. K. Saul, "Distance metric learning for large margin nearest neighbor classification," Journal of Machine Learning Research, vol. 10, no. 9, pp. 207-244, 2009.
3 R. Sun, Z. Wang, K. E. Martens, and S. Lewis, "Convolutional 3D attention network for video based freezing of gait recognition," in Proceedings of Digital Image Computing: Techniques and Applications (DICTA), Canberra, Australia, 2018, pp. 1-7.
4 S. Yu, D. Tan, and T. Tan, "A framework for evaluating the effect of view angle, clothing and carrying condition on gait recognition," in Proceedings of the18th International Conference on Pattern Recognition (ICPR'06), Hong Kong, China, 2006, pp. 441-444.
5 H. Iwama, M. Okumura, Y. Makihara, and Y. Yagi, "The OU-ISIR gait database comprising the large population dataset and performance evaluation of gait recognition," IEEE Transactions on Information Forensics and Security, vol. 7, no. 5, pp. 1511-1521, 2012.   DOI
6 Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning," Nature, vol. 521, no. 5, pp. 436-445, 2015.   DOI
7 X. Wang and W. Q. Yan, "Human gait recognition based on frame-by-frame gait energy images and convolutional long short-term memory," International Journal of Neural Systems, vol. 30, no. 1, article no. 1950027, 2019.
8 J. P. Singh, S. Jain, S. Arora, and U. P. Singh, "Vision-based gait recognition: a survey," IEEE Access, vol. 6, pp. 70497-70527, 2018.   DOI
9 Y. He, and J. Zhang, "Deep learning for gait recognition: a survey," Pattern Recognition and Artificial Intelligence, vol. 31, no. 5, pp. 442-451, 2018.
10 Z. Wu, Y. Huang, L. Wang, X. Wang, and T. Tan, "A comprehensive study on cross-view gait based human identification with deep CNNs," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 2, pp. 209-226, 2017.   DOI
11 X. Wang and K. Yan, "Human gait recognition using continuous density hidden Markov models," Pattern Recognition and Artificial Intelligence, vol. 29, no. 8, pp. 709-717, 2016.
12 N. Takemura, Y. Makihara, D. Muramatsu, T. Echigo, and Y. Yagi, "On input/output architectures for convolutional neural network-based cross-view gait recognition," IEEE Transactions on Circuits and Systems for Video Technology, vol. 29, no. 9, pp. 2708-2719, 2019.   DOI
13 J. Han and B. Bhanu, "Individual recognition using gait energy image," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 2, pp. 316-322, 2006.   DOI
14 S. Choi, J. Kim, W. Kim, and C. Kim, "Skeleton-based gait recognition via robust frame-level matching," IEEE Transactions on Information Forensics and Security, vol. 14, no. 10, pp. 2577-2592, 2019.   DOI
15 X. Wang, J. Wang, and K. Yan, "Gait recognition based on Gabor wavelets and $(2D)^2PCA$," Multimedia Tools and Applications, vol. 77, no. 10, pp. 12545-12561, 2018.   DOI
16 S. C. Bakchy, M. R. Islam, and A. Sayeed, "Human identification on the basis of gait analysis using Kohonen self-organizing mapping technique," in Proceedings of the 2nd International Conference on Electrical, Computer & Telecommunication Engineering (ICECTE), Rajshahi, Bangladesh, 2016, pp. 1-4.
17 A. Sokolova and A. Konushin, "Pose-based deep gait recognition," IET Biometrics, vol. 8, no. 2, pp. 134-143, 2019.   DOI
18 I. Cheheb, N. Al-Maadeed, S. Al-Madeed, and A. Bouridane, "Investigating the use of autoencoders for gait-based person recognition," in Proceedings of NASA/ESA Conference on Adaptive Hardware and Systems (AHS), Edinburgh, UK, 2018, pp. 148-151.
19 X. Wang and W. Q. Yan, "Cross-view gait recognition through ensemble learning," Neural Computing and Applications, vol. 32, no. 11, pp. 7275-7287, 2020.   DOI
20 U. Martinez-Hernandez, A. Rubio-Solis, and A. A. Dehghani-Sanij, "Recognition of walking activity and prediction of gait periods with a CNN and first-order MC strategy," in Proceedings of the 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob), Enschede, Netherlands, 2018, pp. 897-902.
21 X. Wang and S. Feng, "Multi-perspective gait recognition based on classifier fusion," IET Image Processing, vol. 13, no. 11, pp. 1885-1891.