The Journal of Korea Institute of Information, Electronics, and Communication Technology (한국정보전자통신기술학회논문지)

Korea Information Electronic Communication Technology (한국정보전자통신기술학회)
권호 표지
DOI QR코드

DOI QR Code

Emergency Signal Detection based on Arm Gesture by Motion Vector Tracking in Face Area

  • Fayyaz, Rabia (Department of Computer Engineering, Hanbat National University) ;
  • Park, Dae Jun (Department of Computer Engineering, Hanbat National University) ;
  • Rhee, Eun Joo (Department of Computer Engineering, Hanbat National University)
  • Received : 2018.12.18
  • Accepted : 2019.01.24
  • Published : 2019.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents a method for detection of an emergency signal expressed by arm gestures based on motion segmentation and face area detection in the surveillance system. The important indicators of emergency can be arm gestures and voice. We define an emergency signal as the 'Help Me' arm gestures in a rectangle around the face. The 'Help Me' arm gestures are detected by tracking changes in the direction of the horizontal motion vectors of left and right arms. The experimental results show that the proposed method successfully detects 'Help Me' emergency signal for a single person and distinguishes it from other similar arm gestures such as hand waving for 'Bye' and stretching. The proposed method can be used effectively in situations where people can't speak, and there is a language or voice disability.

Keywords

JBJTBH_2019_v12n1_22_f0001.png 이미지

Fig. 1. The flow of the suggested method.

JBJTBH_2019_v12n1_22_f0002.png 이미지

Fig. 2. Arm gestures in time series. (a) At time 0. (b) At time 1. (c) At time 2. (d) At time 3. (e) At time 4. (f) At time 5.

JBJTBH_2019_v12n1_22_f0003.png 이미지

Fig. 3. Motion segmentation. (a) Previous frame. (b) Current frame. (c) Motion s egmentation.

JBJTBH_2019_v12n1_22_f0004.png 이미지

Fig. 4. Example of accurate and inaccurate arm-gesture. (a) Accurate arm-gesture of N-tracking points. (b) Inaccurate arm-gesture of N-tracking points. (c) Accurate arm-gesture of averaged N-tracking points of (a). (d) Accurate arm-gesture of averaged N-tracking points of (b).

JBJTBH_2019_v12n1_22_f0005.png 이미지

Fig. 5. Left and right arm gestures tracking within search area along face. (a) N-tracking points. (b) Average N-tracking points.

JBJTBH_2019_v12n1_22_f0006.png 이미지

Fig. 6. Arm gestures for Help Me.

JBJTBH_2019_v12n1_22_f0007.png 이미지

Fig. 7. Gestures classified as "Help me".

JBJTBH_2019_v12n1_22_f0008.png 이미지

Fig. 8. Gestures classified as "BYE or STRETCHING".

References

  1. M. Sigalas, H. Baltzakis and P. Trahanias, "Gesture recognition based on arm tracking for human-robot interaction", Proc. of 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 5424-5429, 2010.
  2. K. Lai, J. Konrad and P. Ishwar, "A gesture-driven computer interface using Kinect", Proc. of 2012 IEEE Southwest Symposium on Image Analysis and Interpretation, pp. 185-188, 2012.
  3. K. Yamazaki, H. Miyao, and M. Maruyama. "Arm Gesture Recognition Using Continuous DP for User-Defined Gestures", Proc. of HCI International 2013, pp. 21-26, 2013.
  4. O. Amft, H. Junker, and G. Troster. "Detection of eating and drinking arm gestures using inertial body-worn sensors", Proc. of The Ninth International Symposium on Wearable Computers, pp. 160-163, 2005.
  5. S. Joudaki, M. S. B. Sunar, and H. Kolivand. "Background subtraction methods in video streams: a review", Proc. of 2015 4th International Conference on Interactive Digital Media (ICIDM), pp. 1-6, 2015.
  6. L. A. Schwarz, A. Mkhitaryan, D. Mateus and N. Navab, "Human skeleton tracking from depth data using geodesic distances and optical flow", Image and Vision Computing, vol. 30, pp. 217-226, 2012. https://doi.org/10.1016/j.imavis.2011.12.001
  7. Z. Chaohui, X. Duan, S. Xu, Z. Song, and M. Luo, "An improved moving object detection algorithm based on frame difference and edge detection", Proc. of Fourth International Conference on Image and Graphics (ICIG), pp. 519-523, 2007.
  8. Y. I. Cho and S.S. Jang, "Implementation of intelligent Speech Recognition System according to CCTV Emergency Information", Korean Institute of Intelligent Systems, vol. 19, no. 1, pp 121-122, 2009.
  9. J. H. Yu and K. B. Sim, "Face Classification Using Cascade Facial detection and Convolution Neural Network", Korean Institute of Intelligent Systems, vol. 26, no. 1, pp 70-75, 2016. https://doi.org/10.5391/JKIIS.2016.26.1.070
  10. G, R. Bradski and V. Pisarevsky, "Intel's Computer Vision Library: Applications in Calibration, Stereo Segmentation, Tracking, Gesture, Face and Object Recognition", Proc. of IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 796-797, 2000.