Journal of Advanced Information Technology and Convergence (한국정보기술학회 영문논문지)

Korean Institute of Information Technology (한국정보기술학회)
권호 표지
DOI QR코드

DOI QR Code

Design of Image Extraction Hardware for Hand Gesture Vision Recognition

  • Received : 2020.07.10
  • Accepted : 2020.07.28
  • Published : 2020.07.31
⟨ Previous Next ⟩

Abstract

In this paper, we propose a system that can detect the shape of a hand at high speed using an FPGA. The hand-shape detection system is designed using Verilog HDL, a hardware language that can process in parallel instead of sequentially running C++ because real-time processing is important. There are several methods for hand gesture recognition, but the image processing method is used. Since the human eye is sensitive to brightness, the YCbCr color model was selected among various color expression methods to obtain a result that is less affected by lighting. For the CbCr elements, only the components corresponding to the skin color are filtered out from the input image by utilizing the restriction conditions. In order to increase the speed of object recognition, a median filter that removes noise present in the input image is used, and this filter is designed to allow comparison of values and extraction of intermediate values at the same time to reduce the amount of computation. For parallel processing, it is designed to locate the centerline of the hand during scanning and sorting the stored data. The line with the highest count is selected as the center line of the hand, and the size of the hand is determined based on the count, and the hand and arm parts are separated. The designed hardware circuit satisfied the target operating frequency and the number of gates.

Keywords

Acknowledgement

This research was supported by Kumoh National Institute of Technology (2018104130).

References

  1. O.C. Zienkiewicz, "The Finite Element Method 3rd ed.", in McGraw-Hill, London, 1977. pp. 10-20.
  2. S. S. Rautaray and A. Agrawal, "Vision based hand gesture recognition for human computer interaction: a survey", Artif. Intell. Rev., Vol. 43, No. 1, pp. 1-54, January 2012. https://doi.org/10.1007/s10462-012-9356-9
  3. J. Shotton, T. Sharp, A. Kipman, A. Fitzgibbon, M. Finocchio, A. Blake, M. Cook, and R. Moore, "Real-time human pose recognition in parts from single depth images", Communications of the ACM, Vol. 56, No. 1, pp. 116-124, January 2013. https://doi.org/10.1145/2398356.2398381
  4. K. Oka, Y. Sato, and H. Koike, "Real-time fingertip tracking and gesture recognition", IEEE computer graphics and applications, Vol. 22, No. 6, pp. 64-71, December 2002. https://doi.org/10.1109/MCG.2002.1046630
  5. S. Jeong and M. Lee, "Visual C++ Digital Image Processing using Open Source CxImage", Hongrung Publishing Company, Seoul, Korea, 2007.
  6. V. A. Oliveira and A. Conci, "Skin Detection using HSV Color Space", Proceeding of H. Pedrini & J. Marques de Carvalho, Workshops of. Sibgrapi, Brazil, 2009.
  7. Z. Zhengzhen and S. Yuexiang, "Skin Color Detecting Unite YCgCb Color Space with YCgCr Color Space", Proceeding of International Conference on Image Analysis and Signal Processing, Taizhou, China, April 2009, pp. 221-225.
  8. S. Park and U. Lee, "Hand Gesture Recognition Algorithm Robust to Complex Image", Journal of Korea Multimedia Society, Vol. 13, No. 7, pp. 1000-1015, July 2010.
  9. J. Wen and Y. Zhan, "Vision-Based Two Hand Detection and Tracking", 2nd International Conference on Interaction Sciences Information Technology, Culture and Human - ICIS, Seoul Korea, November 2009, pp. 1253-1258.
  10. P. K. Pisharady, P. Vadakkepat, and A. P. Loh, "Attention based detection and recognition of hand postures against complex backgrounds", International Journal of Computer Vision, Vol. 101, No. 3, pp. 403-419, August 2012. https://doi.org/10.1007/s11263-012-0560-5
  11. Salim, Ula Tarik, Dawwd, and Shefa Abdulrahman, "Systolic hand gesture recognition/detection system based on FPGA with multi-port BRAMs", Alexandria engineering journal AEJ, Vol. 58, No. 3, pp. 841-848, August 2019. https://doi.org/10.1016/j.aej.2019.05.018
  12. Y. Y. Pang, N. A. Ismail, and P. L. S. Gilbert, "A real time vision-based hand gesture interaction", in Proc. 2010 Fourth Asia International Conference on Mathematical/ Analytical Modelling and Computer Simulation, Bornea, Malaysia, May 2010, pp. 237-242.
  13. Y. Fang, K. Wang, J. Cheng, and H. Lu, "A real-time hand gesture recognition method", in Proc. IEEE International Conference on Multimedia and Expo, Beijing, China, July 2007, pp. 995-998.
  14. M. Kolsch and M. Turk, "Robust hand detection", in Proc. IEEE International Conference on Automatic Face and Gesture Recognition, May 2004, pp. 614-619.
  15. C. Wang and K. Wang, "Hand posture recognition using Adaboost with SIFT for human robot interaction", in Recent progress in robotics: viable robotic service to human. Springer Berlin Heidelberg, Vol. 370, pp. 317-329, January 2008.
  16. C.Y. Lee, "Design of Parallel Array Type Lane Detection Hardware for High-speed Processing", M.S. dissertation, Department of Electronic, Engineering, Kumoh National Institute of Technology, Gumi, Korea, 2018.
  17. S.Y. Kwon, "Parallel Processing Hardware Accelerator for Detecting Shape of Hand", M.S. dissertation, Department of Electronic, Engineering, Kumoh National Institute of Technology, Gumi, Korea, 2018.