The Journal of the Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회논문지)

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

Implementation of non-Wearable Air-Finger Mouse by Infrared Diffused Illumination

적외선 확산 투광에 의한 비장착형 공간 손가락 마우스 구현

  • Lee, Woo-Beom (School of Computer Information Engineering, Sangji University)
  • 이우범 (상지대학교 컴퓨터정보공학부)
  • Received : 2015.01.05
  • Accepted : 2015.04.10
  • Published : 2015.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

Extraction of Finger-end points is one of the most process for user multi-commands in the Hand-Gesture interface technology. However, most of previous works use the geometric and morphological method for extracting a finger-end points. Therefore, this paper proposes the method of user finger-end points extraction that is motivated a ultrared diffused illumination, which is used for the user commands in the multi-touch display device. Proposed air-mouse is worked by the quantity state and moving direction of extracted finger-end points. Also, our system includes a basic mouse event, as well as the continuous command function for expending a user multi-gesture. In order to evaluate the performance of the our proposed method, after applying to the web browser application as a command device. As a result, the proposed method showed the average 90% success-rate for the various user-commands.

손-동작(Hand-Gesture) 인터페이스 기술에서 사용자의 다중 입력을 위하여 손가락 끝점(Finger end-points)의 추출은 가장 중요한 과정 가운데 하나이다. 그러나 이전의 방법들은 손 영역을 추출하고 기하학적 또는 형태학적 영상 처리 방법에 기반하여 손-동작 명령 수행을 위한 손가락 끝점 추출을 수행하고 있다. 따라서 본 논문에서는 멀티터치(Multi-Touch) 디스플레이 장치에서 사용자 입력 처리를 위해서 사용되는 적외선 확산 투광(DI: Diffused illumination) 방식을 이용하여 사용자 손가락 끝점을 추출하고, 추출된 끝점의 개수 변화 및 이동 방향에 의해서 동작하는 공간 마우스를 구현한다. 제안하는 공간 마우스는 기본적인 마우스 이벤트 처리뿐만 아니라, 확장된 사용자 멀티 제스쳐를 위한 연속적 명령 기능을 포함한다. 구현된 공간 마우스의 성능 평가를 위해서 윈도우 웹 브라우져 어플리케이션 사용 환경에 적용한 결과 다양한 사용자 명령에 대하여 평균 90%의 성공적 결과를 보였다.

Keywords

References

  1. R. Z. Khan and N. A. Ibraheem, "Survey on Gesture Recognition for Hand Image Posture", Computer and Information Science Vol. 5(3), pp. 110-121, 2012.
  2. S. Mitra and T. Acharya, "Gesture Recognition: A Survey", IEEE Trans. on SMC Vol. 37(3), pp. 311-324, 2007.
  3. Jefferson Y. Han, "Low-cost multi-touch sensing through frustrated total internal reflection", Proceedings of the 18th annual ACM symposium on User interface software and technology, pp.115-118, New York, NY, USA, 2005.
  4. L.Y.L. Muller, "Multi-touch display: design, application and performance evaluation", M.S. Thesis, Univ. of Amsterdam, 2008.
  5. Woobeom Lee, "Implementation of a DI Multi-Touch Display Using an Improved Touch-Points Detection and Gesture Recognition", Journal of The Institute of Signal Processing and Systems, vol.11(1), pp. 13-18, 2010.
  6. Y. Cheng, "Mean shift, mode seeking, and clustering", IEEE Trans. PAMI, 17:790-799, 1995. https://doi.org/10.1109/34.400568
  7. Open Source Computer Vision Library: Reference Manual, Intel, 2001. (http://opencv.org/)
  8. David Wallin, Touchlib: an opensource multi-touch framework, 2006. (http://nuigroup.com/touchlib/)
  9. X. Shen, etc., "Dynamic hand gesture recognition: An exemplar-based approach from motion divergence fields", Image and Vision Computing 30, pp. 227-235, 2012. https://doi.org/10.1016/j.imavis.2011.11.003
  10. V. A. Prisacariu and I. Reid, "3D hand tracking for human computer interaction", Image and Vision Computing 30, pp. 236-250, 2012. https://doi.org/10.1016/j.imavis.2012.01.003
  11. M. S. Jang and W. B. Lee, "Implement of Finger-Gesture Controller using the Moving Direction Recognition of Single Shape", The Journal of The IIBC, Vol. 13(4), pp. 91-97, 2013.

Cited by

  1. A MEMS-Based Finger Wearable Computer Input Devices vol.20, pp.6, 2016, https://doi.org/10.6109/jkiice.2016.20.6.1103