한국지능시스템학회논문지 (Journal of the Korean Institute of Intelligent Systems)

  • 제21권6호
  • /
  • Pages.718-723
  • /
  • 2011
  • /
  • 1976-9172(pISSN)
  • /
  • 2288-2324(eISSN)
한국지능시스템학회 (Korean Institute of Intelligent Systems)
권호 표지
DOI QR코드

DOI QR Code

비젼 카메라를 이용한 멀티 터치 입력 장치

Visual Multi-touch Input Device Using Vision Camera

  • 서효동 (군산대학교 제어로봇공학과) ;
  • 주영훈 (군산대학교 제어로봇공학과)
  • 투고 : 2011.11.19
  • 심사 : 2011.12.13
  • 발행 : 2011.12.25
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

본 논문에서는 비젼 카메라를 이용한 비주얼 멀티 터치 입력 장치를 제안한다. 제안된 입력 장치는 비젼 카메라를 이용하므로 기존 스마트 폰에서 사용하는 터치 스크린 입력 장치에 비해 non-touch로 명령을 입력할 수 있다는 장점이 있다. 또한, 제안된 장치는 컴퓨터 계산 시간이 짧아 실시간 구현이 가능하고, 카메라외에 다른 장치가 필요 없으므로 존재하는 입력장치보다 싸다는 장점이 있다. 이를 위해, 먼저, HSV 컬러 모델과 라벨링 방법을 이용한 영상 처리 알고리즘을 제안한다. 그 다음, 손이 움직이는 영역의 정확성을 개선하기위해, 기하학적인 특징점, 동심원, 칼만 필터에 기본한 움직임 인식 알고리즘을 제안한다. 마지막으로, 제안된 장치는 비디오 게임, 스마트 TV, 컴퓨터등을 원격으로 제어할 수 있음을 실험을 통해 보인다.

In this paper, we propose a visual multi-touch air input device using vision cameras. The implemented device provides a barehanded interface which copes with the multi-touch operation. The proposed device is easy to apply to the real-time systems because of its low computational load and is cheaper than the existing methods using glove data or 3-dimensional data because any additional equipment is not required. To do this, first, we propose an image processing algorithm based on the HSV color model and the labeling from obtained images. Also, to improve the accuracy of the recognition of hand gestures, we propose a motion recognition algorithm based on the geometric feature points, the skeleton model, and the Kalman filter. Finally, the experiments show that the proposed device is applicable to remote controllers for video games, smart TVs and any computer applications.

키워드

참고문헌

  1. R. Cowie, "Emotion Recognition In Human-Computer Interaction," Signal Processing Magazine, IEEE, Vol. 18 pp. 32-80, January 2001. https://doi.org/10.1109/79.911197
  2. T. Huang, and V. Pavloic, "Hand Gesture Modeling, Analysis, and Synthesis," International Workshop on Automatic Face and Gesture-recongnition, pp. 73-79, June 1995.
  3. F. Karray, M. Alemzadeh, J. Saleh, and M. Arab, "Human-Computer Interaction: Overview on State of the Art," Int. Journal on Smart Sensing and Intelligent Systems, Vol. 1, No. 1, pp. 137-159, March 2008. https://doi.org/10.21307/ijssis-2017-283
  4. Francis K. H. Quek, "Toward a Vision-Based hand Gesture Interface," Conference on Virtual Realty Software and Technology, pp. 23-26, August. 1994.
  5. J. Han, "Low-Cost Multi-Touch Sensing through Frustrated Total Internal Reflection," In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, pp. 115-118, 2005.
  6. S. Oviatt, "Advances in Robust Multimodal Interface Design," IEEE Computer Graphics and Applications, Vol.23 pp. 62-68, October 2003.
  7. C. Spence, "Cross-modal Attention and Multisensory Integration: Implications for Multimodal Interface Design," Int. Conference on Multi-modal Interfaces, Vol. 5, November 2003.
  8. M. Kolsch, R. Bane, T. Hollerer, and M. Turk, "Multimodal Interaction with a Wearable Augmented Reality System," IEEE Computer Graphics and Applications, Vol. 26, No. 3 pp. 62-71, June 2006. https://doi.org/10.1109/MCG.2006.66
  9. M. Kim, and J. Yoon, "Implementation of Mobile Game Interface through an Operating Interface Analysis of Touch-screen Devices," Journal of Society of Design Science, No. 81, pp. 231-244, 2009.
  10. J. Rantala, R. Raisamo, J. Lylykangas, V. Surakka, J. Raisamo, K. Salminen, T. Pakkanen, and A. Hippula, "Methods for Presenting Braille Characters on a Mobile Device with a Touchscreen and Tactile Feedback," IEEE Trans. on Haptics, Vol. 2, No. 1, pp. 28-39, 2009. https://doi.org/10.1109/TOH.2009.3
  11. F. Wang, H. Deng, K. Ki, and Q. Ting, "A Study on Image Splicing Algorithm for Large Screen Multi-touch Technique," Machine Vision and Human- machine Interface, pp. 526-529, April 2010.
  12. V. I Pavlovic, R. Sharma, and T.S. Huang, "Visual Interpretation of Hand Gestures for Human-computer Interaction: a Review," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 19, No. 7, pp. 677-695, July 1997. https://doi.org/10.1109/34.598226
  13. M. Ishikawa and H. Matsumura, "Recognition of a Hand-gesture Based on Self-organization Using a Data Glove," ICONIP '99, Vol. 2, pp. 739-745, 1999.
  14. S. S. Fels and G. E. Hinton, "Glove-talk: A Neural Network Interface between a Data Glove and a Speech Synthesizer," IEEE Trans. Neural Networks, Vol. 4, No. 1, pp. 2-8, January 1993. https://doi.org/10.1109/72.182690