Browse > Article
http://dx.doi.org/10.12673/jant.2022.26.5.365

Design and Implementation of BNN-based Gait Pattern Analysis System Using IMU Sensor  

Na, Jinho (School of Electronics and Information Engineering, Korea Aerospace University)
Ji, Gisan (School of Electronics and Information Engineering, Korea Aerospace University)
Jung, Yunho (School of Electronics and Information Engineering, Korea Aerospace University)
Publication Information
Journal of Advanced Navigation Technology / v.26, no.5, 2022 , pp. 365-372 More about this Journal
Abstract
Compared to sensors mainly used in human activity recognition (HAR) systems, inertial measurement unit (IMU) sensors are small and light, so can achieve lightweight system at low cost. Therefore, in this paper, we propose a binary neural network (BNN) based gait pattern analysis system using IMU sensor, and present the design and implementation results of an FPGA-based accelerator for computational acceleration. Six signals for gait are measured through IMU sensor, and a spectrogram is extracted using a short-time Fourier transform. In order to have a lightweight system with high accuracy, a BNN-based structure was used for gait pattern classification. It is designed as a hardware accelerator structure using FPGA for computation acceleration of binary neural network. The proposed gait pattern analysis system was implemented using 24,158 logics, 14,669 registers, and 13.687 KB of block memory, and it was confirmed that the operation was completed within 1.5 ms at the maximum operating frequency of 62.35 MHz and real-time operation was possible.
Keywords
Binarized neural network; Binary weight network; FPGA Gait analysis; IMU-based spectrogram;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 S. Lee, D. Har and D. Kum, "Drone-Assisted Disaster Management: Finding Victims via Infrared Camera and Lidar Sensor Fusion," 2016 3rd Asia-Pacific World Congress on Computer Science and Engineering (APWC on CSE), Nadi, Fiji, pp. 84-89, Dec. 2016.
2 Huang, H., Zhou, P., Li, Y., Sun, F., "A Lightweight Attention-Based CNN Model for Efficient Gait Recognition with Wearable IMU Sensors," Sensors 2021, Vol. 21, No. 8, pp. 2866, Apr. 2021.   DOI
3 M. D. Nguyen et al., "IMU-based Spectrogram Approach with Deep Convolutional Neural Networks for Gait Classification," 2020 IEEE International Conference on Consumer Electronics (ICCE), Taoyuan, Taiwan, pp. 1-6, Mar. 2020.
4 M. Courbariaux, I. Hubara, D. Soudry, R. E. Yaniv, Y. Bengio, (2016, March). Binarized neural networks: Training deep neural networks with weights and activations constrained to +1 or -1. arXiv [Online]. Available: https://arxiv.org/abs/1602.02830.
5 F. Luo, S. Poslad and E. Bodanese, "Temporal Convolutional Networks for Multiperson Activity Recognition Using a 2-D LIDAR," IEEE Internet of Things Journal, Vol. 7, No. 8, pp. 7432-7442, Mar. 2020.   DOI
6 T. Tan, Z. A. Strout, H. Xia, M. Orban and P. B. Shull, "Magnetometer-Free, IMU-Based Foot Progression Angle Estimation for Real-Life Walking Conditions," IEEE Transactions on Neural Systems and Rehabilitation Engineering, Vol. 29, No. 28, pp. 282-289, Dec. 2021.   DOI
7 L. V. R. Asuncion, J. X. P. D. Mesa, P. K. H. Juan, N. T. Sayson and A. R. D. Cruz, "Thigh Motion-Based Gait Analysis for Human Identification using Inertial Measurement Units (IMUs)," 2018 IEEE 10th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM), Baguio, Philippines, pp. 1-6, Mar. 2019.
8 M. Gadaleta, L. Merelli and M. Rossi, "Human authentication from ankle motion data using convolutional neural networks," 2016 IEEE Statistical Signal Processing Workshop (SSP), Palma de Mallorca, Spain, pp. 1-5, Aug. 2016.
9 Wouda, F.J., Jaspar, S.L.J.O., Harlaar, J. et al, "Foot progression angle estimation using a single foot-worn inertial sensor," Journal of NeuroEngineering and Rehabilitation, Vol. 18, No. 37, Feb. 2021.
10 Tao, S., Zhang, X., Cai, H. et al, "Gait based biometric personal authentication by using MEMS inertial sensors," Journal of Ambient Intelligence and Humanized Computing, Vol. 9, No. 5, pp. 1705-1712, May. 2018.   DOI
11 Jeonghee Nam, Chaeyoung Kang, Jeongyeon Kook and Yunho Jung, "Design and Implementation of CW Radar-based Human Activity Recognition System," The Journal of Korea Navigation Institute, Vol. 25, No. 5, pp. 415-425, Oct. 2021.
12 Youshin Chung, Yunho Jung, "Design and Implementation of CNN-Based Human Activity Recognition System using WiFi Signals," The Journal of Korea Navigation Institute, Vol. 25, No. 4, pp. 299-304, Aug. 2021.
13 Meng Chen, Bufu Huang and Yangsheng Xu, "Intelligent shoes for abnormal gait detection," 2008 IEEE International Conference on Robotics and Automation, Pasadena, CA, USA, pp. 2019-2024, Jun. 2008.