Browse > Article
http://dx.doi.org/10.12673/jant.2021.25.5.426

Design and Implementation of CW Radar-based Human Activity Recognition System  

Nam, Jeonghee (School of Electronics and Information Engineering, Korea Aerospace University)
Kang, Chaeyoung (School of Electronics and Information Engineering, Korea Aerospace University)
Kook, Jeongyeon (School of Electronics and Information Engineering, Korea Aerospace University)
Jung, Yunho (School of Electronics and Information Engineering, Korea Aerospace University)
Abstract
Continuous wave (CW) Doppler radar has the advantage of being able to solve the privacy problem unlike camera and obtains signals in a non-contact manner. Therefore, this paper proposes a human activity recognition (HAR) system using CW Doppler radar, and presents the hardware design and implementation results for acceleration. CW Doppler radar measures signals for continuous operation of human. In order to obtain a single motion spectrogram from continuous signals, an algorithm for counting the number of movements is proposed. In addition, in order to minimize the computational complexity and memory usage, binarized neural network (BNN) was used to classify human motions, and the accuracy of 94% was shown. To accelerate the complex operations of BNN, the FPGA-based BNN accelerator was designed and implemented. The proposed HAR system was implemented using 7,673 logics, 12,105 registers, 10,211 combinational ALUTs, and 18.7 Kb of block memory. As a result of performance evaluation, the operation speed was improved by 99.97% compared to the software implementation.
Keywords
Accelerator; Binarized neural network; CW Doppler radar; FPGA; Human activity recognition;
Citations & Related Records
연도 인용수 순위
  • Reference
1 E. H. Yoo, "Online privacy, technologies, and perceived risk," The Journal of Social Science, Vol. 25, No. 2, pp. 82-100, Jun. 2018.   DOI
2 A. Tharwat, H. Mahdi, M. Elhoseny, A. E. Hassanien, "Recognizing human activity in mobile crowdsensing environment using optimized k-NN algorithm," Expert Systems with Applications, Vol. 107, pp. 32-44, Oct. 2018.   DOI
3 R. J. Javier, Y. Kim, "Application of linear predictive coding for human activity classification," IEEE Geoscience and Remote Sensing Letters, Vol. 11, No. 10, pp. 1831-1834, Oct. 2014.   DOI
4 S. M. Lee, S. M. Yoon, H. R. Cho, "Human activity recognition from accelerator data using convolutional neural network," IEEE International Conference on Big Data and Smart Computing (BigComp), Jeju, Korea (South), pp. 131-134, 2017.
5 J. G. Cho, "Human activity recognition using sensor fusion and kernel discriminant analysis on smartphones," Journal of the Korea Convergence Society, Vol. 11, No. 5, pp. 9-17, May. 2020.   DOI
6 K. J. Baik, B. J. Jang, "Hand gesture classification using multiple doppler radar and machine learning," The Journal of Korean Institute of Electromagnetic Engineering and Science, Vol. 28, No. 1, pp. 33-41, Jan. 2017.   DOI
7 Y. Lecun, L. Bottou, Y. Bengio, P. Haffner, "Gradient-based learning applied to document recognition," Proceedings of the IEEE, Vol. 86, No. 11, pp. 2278-2324, Nov. 1998.   DOI
8 F. Luo, S. Poslad, E. Bodanese, "Kitchen activity detection for healthcare using a low-power radar-enabled sensor network," ICC 2019 - 2019 IEEE International Conference on Communications (ICC), Shanghai, China, pp. 1-7, 2019.
9 Q. Zhang, M. Zhang, T. Chen, Z. Sun, Y. Ma, B. Yu, "Recent advances in convolutional neural network acceleration," Neurocomputing, Vol. 323, pp. 37-51, Jan. 2019.   DOI
10 Y. W. Kim, H. Ling, "Human activity classification based on micro-doppler signatures using an artificial neural network," IEEE Antennas and Propagation Society International Symposium, San Diego, CA, USA, pp. 1-4, 2008.
11 D. Yang, J. Huang, X. Tu, G. Ding, T. Shen, X. Xiao, "A Wearable Activity Recognition Device Using Air-Pressure and IMU Sensors," IEEE Access, Vol. 7, pp. 6611-6621, Dec. 2018.   DOI
12 J. H. Suk, J. D. Jeon, C. G. Lyuh, "State-of-the-art on gesture sensing technology based on infrared proximity sensor," The Optical Journal, Vol. 161, pp. 58-73, Jan. 2016.
13 M. Courbariaux, I. Hubara, D. Soudry, R. E. Yaniv, Y. Bengio, (2016, March). Binarized neural networks: Training deep neural networks with weights and activations constrained to +1 or -1. arXiv [Online]. Available: https://arxiv.org/abs/1602.02830.
14 I. Alnujaim, D. Oh, Y. Kim, "Generative adversarial networks for classification of micro-doppler signatures of human activity," IEEE Geoscience and Remote Sensing Letters, Vol. 17, No. 3, pp. 396-400, Mar. 2020.   DOI
15 M. Zeng, L. T. Nguyen, B. Yu, O. J. Mengshoel, J. Zhu, P. Wu, J. Zhang, "Convolutional neural networks for human activity recognition using mobile sensors," 6th International Conference on Mobile Computing, Applications and Services, Austin TX USA, pp. 197-205, Nov. 2014.
16 D. H. Jang, H. Kim, Y. H. Jung, "Design and implementation of human-detecting radar system for indoor security applications," The Institute of Korean Electrical and Electronics Engineers, Vol. 24, No. 3, pp. 783-790, Sep. 2020.