Journal of Korea Society of Industrial Information Systems (한국산업정보학회논문지)

Korea Society of Industrial Information Systems (한국산업정보학회)
권호 표지
DOI QR코드

DOI QR Code

Video event control system by recognition of depth touch

깊이 터치를 통한 영상 이벤트 제어 시스템

  • 이동석 (동의대학교 컴퓨터소프트웨어공학과) ;
  • 권순각 (동의대학교 컴퓨터소프트웨어공학과)
  • Received : 2016.02.12
  • Accepted : 2016.02.19
  • Published : 2016.02.29
Download PDF
⟨ Previous Next ⟩

Abstract

Various events of stop, playback, capture, and zoom-in/out in playing video is available in the monitor of a small size such as smart phones. However, if the size of the display increases, then the cost of the touch recognition is increased, thus provision of a touch event is not possible in practice. In this paper, we propose a video event control system that recognizes a touch inexpensively from the depth information, then provides the variety of events of the toggle, the pinch-in / out by the single or multi-touch. The proposed method finds a touch location and the touch path by the depth information from a depth camera, and determines the touch gesture type. This touch interface algorithm is implemented in a small single-board system, and can control the video event by sending the gesture information through the UART communication. Simulation results show that the proposed depth touch method can control the various events in a large screen.

재생되는 동영상에서 정지, 재생, 캡쳐, 확대, 축소 등의 다양한 이벤트 제공은 스마트폰과 같은 작은 크기의 모니터에서 가능하다. 그러나, 모니터의 크기가 커지게 되면, 터치 인식에 대한 비용이 증가하게 되어, 터치를 통한 이벤트 제공은 사실상 불가능하다. 본 논문에서는 저렴하게 깊이 정보로 터치를 인식하고, 단일 및 다중 터치로 토글, 핀치-인/아웃 등의 다양한 이벤트를 부여하는 영상 이벤트 제어시스템을 제안한다. 깊이 카메라로부터 얻어진 깊이 정보로 터치된 위치와 터치 경로를 찾고, 터치 제스처 종류를 파악한다. 이러한 터치 인터페이스 알고리즘은 소형 싱글보드 시스템에서 구현하고, UART 통신을 통해 제스처 정보를 전송함으로써 영상 이벤트를 제어할 수 있다. 모의실험을 바탕으로 대형 스크린에서 제안한 깊이 터치 방법으로 다양한 영상 이벤트를 제어할 수 있음을 보인다.

Keywords

References

  1. K. Kin, M. Agrawala and T. DeRose, "Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation," Proceeding of Graphics Interface 2009, pp. 119-124, 2009.
  2. S. B. Han, S. Y. Yoon and Tae-Kyun Kim, "A study on the application of design through comparative assessment of users' experience in regard to the input interface mode on mobile phones," Journal of Digital Design, Vol. 11, No. 1, pp. 325-334, 2011.
  3. D. H. Lee, M. K. Kang and T. S. Yun, "Development of a tangible interface using multi-touch display on an irregular surface," Journal of the Korea Industrial Information Systems Research, Vol. 16, No. 3, pp. 65-72, 2011.
  4. J. I. Lee, S. C. Kim and H.C. Won, "Voice-based messenger using NXT touch-sensor input unit and the bluetooth wireless communication for the blind," Journal of the Korea Industrial Information Systems Research, Vol. 13, No. 5, pp. 78-86, 2008.
  5. E. S. Ko, Y. W. Rhee and C. W. Lee, "Implementation of commercial IWB interface using image processing," Journal of the Korea Industrial Information Systems Research, Vol. 17, No. 6, pp. 19-24, 2012. https://doi.org/10.9723/jksiis.2012.17.6.019
  6. V. Soni, M. Patel and R. S. Narde, "An interactive infrared sensor based multi-touch panel," International Journal of Scientific and Research Publications, Vol. 3, No. 3, 2013.
  7. S. W. Jung, O. J. Kwon and Y. J. Jeong, "Design of an infrared multi-touch screen controller using stereo vision," The Institute of Electronics Engineers of Korea - Semiconductor and Devices, Vol. 47, No. 2, pp. 68-76, 2010.
  8. H. Nonaka and T. Da-te, "Ultrasonic position measurement and its applications to human interface," IEEE Transactions on Instrumentation and Measurement, Vol. 44, No. 3, pp. 771-774, 1995. https://doi.org/10.1109/19.387329
  9. G.F. Russell, B.A. Smith and T.G. Zimmerman, Digital Pen using Ultrasonic Tracking. 6703570, U.S. ,2004.
  10. D. S. Lee and S. K. Kwon, "Touch pen using depth information," Journal of Korea Multimedia Society, Vol. 18, No. 11, pp. 1313-1318, 2015. https://doi.org/10.9717/kmms.2015.18.11.1313
  11. D. S. Lee and S. K. Kwon, "Touch event method using depth information," Proceeding of The 11th International Conference on Multimedia Information Technology and Applications, 2015.
  12. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, Cambridge university Press, Cambridge, 2004.
  13. S. K. Kwon, Y. H. Park, O. J. Kwon, and S. W. Han, "Cascade mentoring system for computer major education," Journal of the Korea Industrial Information Systems Research, Vol. 20, No. 5, pp. 71-80, 2015.

Cited by

  1. 임베디드 환경에서 실시간 가상 터치 인식 시스템의 구현 vol.19, pp.10, 2016, https://doi.org/10.9717/kmms.2016.19.10.1759