Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on Design and Implementation of Gesture Proposal System

제스처 제안 시스템의 설계 및 구현에 관한 연구

  • 문성현 (서울대학교 컴퓨터공학부) ;
  • 윤태현 (서울대학교 컴퓨터공학부) ;
  • 황인성 (서울대학교 컴퓨터공학부) ;
  • 김석규 (한국과학기술정보연구원 슈퍼컴퓨팅본부) ;
  • 박준 (홍익대학교 컴퓨터공학부) ;
  • 한상영 (서울대학교 컴퓨터공학부)
  • Received : 2011.03.17
  • Accepted : 2011.09.20
  • Published : 2011.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

Gesture is applied in many applications such as smart-phone, tablet-PC, and web-browser since it is a fast and simple way to invoke commands. For gesture applications, a gesture designer needs to consider both user and system during designing gestures. In spite of development of gesture design tools, some difficulties for gesture design still remains as followings; first, a designer must design every gesture manually one by one, and, second, a designer must repeatedly train gestures. In this paper, we propose a gesture proposal system that automates gesture training and gesture generation to provide more simple gesture design environment. Using automation of gesture training, a designer does not need to manually train gestures. Proposed gesture proposal system would decrease difficulties of gesture design by suggesting gestures of high recognition possibility that are generated based on mahalanobis distance calculation among generated and pre-existing gestures.

제스처는 빠르고 간편하게 명령을 수행 할 수 있어서 스마트폰과 태블릿PC, 웹브라우저를 비롯한 수많은 어플리케이션에서 사용되고 있다. 어플리케이션에 제스처를 적용하기 위해서는 제스처를 디자인해야하는데 사용자와 시스템 두 가지 측면을 모두 고려하여 디자인해야 한다. 이러한 제스처 디자인을 도와주고자 몇몇 툴들이 개발되어왔다. 그럼에도 불구하고 제스처를 디자인하기 위해서는 다음과 같은 어려움이 남아있다. 첫째, 모든 제스처를 사람이 직접 디자인해야 한다. 둘째, 디자인한 제스처를 인식기가 올바르게 인식할 수 있도록 반복적인 트레이닝 작업을 해야 한다. 본 논문에서는 보다 간편한 제스처 디자인 환경을 제공해 주고자 자동화 트레이닝, 제스처 제안, 제스처 생성을 제안하였다. 이를 통해 제스처를 트레이닝 시킬 필요가 없어졌고 생성된 제스처와 수집된 제스처의 마할라노비스 거리를 계산하여 이 중 인식이 잘 될 가능성이 높은 순서대로 제스처들을 제안해 줌으로서 모든 제스처를 직접 디자인해야 하는 노력을 줄일 수 있게 되었다.

Keywords

References

  1. Apple, www.apple.com
  2. Samsung Electronics, http://www.samsung.com/sec/
  3. A. Long, A. James, and A. Lawrence, "PDA and Gesture User in Practice: Insights for Designers of Pen-based User Interfaces," Technical Report UCB//CSD-97-976, 1997.
  4. Google Chrome Plus, http://www.chromeplus.org/
  5. Altoolbar, http://www.altools.co.kr/Product/ALToolbar_Function.aspx
  6. Naver WebToolbar, http://toolbar.naver.com/intro/index.nhn?menuId=15
  7. C. Henrique and Q. Forster, "Design of Gesture Vocabularies through Analysis of Recognizer Performance in Gesture Space," Intelligent Systems Design and Applications, pp. 641-646, 2007.
  8. A. Long, A. James, and A. Lawrence, "Implications for a Gesture Design Tool," Proc. CHI , ACM Press, pp. 40-47, 1999.
  9. W. Krzanowski, Priniciples of Mutivariate Analysis: A Users's Perspective, Oxford Statistical Science Series, Vol.3, Oxford University Press, 1988.
  10. A. Long, A. James, and A. Lawrence, "Quill: A Gesture Design Tool for Pen-based User Interfaces," [Ph.D. Thesis] Berkeley: University of California, 2001.
  11. D. Rubine, "Specifying Gestures by Examples," Proc. SIGGRAPH, ACM Press, pp. 329-337, 1991.
  12. W. Dai and G. Shi, "Gesture-based Chemical Formula Editing System," IEEE Computer Society, 2009.
  13. A. Long, A. James, and A. Lawrence, "Visual Similarity of Pen Gestures," Proc. CHI , ACM Press, pp. 360-367, 2000.
  14. F. Tian, T. Cheng, H. Wang, and G. Dai, "Research on User-Centered Design and Recognition Pen Gestures," Proc. CGI , LNCS 4035, pp. 312-323, 2006.
  15. A. Paivio, Mental representations: A dual coding approach. Oxford University Press, 1986
  16. D. Anderson, C. Bailey, and M. Skubic, "Hidden Markov Model symbol recognition for sketch-based interfaces," AAAI Fall Symposium, AAAI Press, pp. 15-21, 2006.
  17. X. Cao and R. Balakrishnan, "Evaluation of An On-Line Adaptive Gesture Interface With Command Prediction," Proc. Graphics Interface, CHCCS Press, pp. 187-194, 2005.
  18. T. Sezgin and R. Davis, "HMM-Based Efficient Sketch Recognition," Proc. IUI , ACM Press, pp. 281-283, 2005.
  19. 김종호, 윤요섭, 김태영, and 임철수, "은닉 마르코프 모델 기반 동작 인식 방법," 한국멀티미디어학회논문지, v.12, no.4, pp.521-529, 2009.
  20. J. Pittman, "Recognizing Handwritten Text," Proc. CHI , ACM Press, pp. 271-275, 1991.
  21. M. Cho, "A New Gesture Recognition Algorithm and Segmentation Method of Korean Scripts for Gesture Allowed Ink Editor," Information Sciences, ESI Press, 176(9), pp. 1290-1303, 2006. https://doi.org/10.1016/j.ins.2005.04.006
  22. C. Myers and L. Rabiner, "A Comparative Study of Several Dynamic Time-Warping Algorithms for Connected Word Recognition," The Bell System Technical J , 60(7), pp. 1389-1409, 1981. https://doi.org/10.1002/j.1538-7305.1981.tb00272.x
  23. C. Tappert, "Cursive Script Recognition by Elastic Matching," IBM J . of Research & Development, 26(6), pp. 765-771, 1982. https://doi.org/10.1147/rd.266.0765
  24. M. Notowidigdo, and B. Miller, "Off-Line Sketch Interpretation," AAAI Fall Symposium, AAAI Press, pp. 120-126, 2004.
  25. A. Wilson and S. Shafer, "XWand: UI for Intelligent Spaces," Proc CHI , ACM Press, pp. 545-552, 2003.
  26. S. Zhai and P. Kristensson, "Shorthand Writing on Stylus Keyboard," Proc. CHI , ACM Press, pp. 97-104, 2003.
  27. I. Jason and A. James, "SATIN: A Toolkit for Informal Ink-Based Applications," Proc. UIST, pp. 63-72, 2000.
  28. Jumping Mind, http://jeroenarendsen.nl/2006/04/pen-gestures/
  29. MindView, http://www.matchware.com/en/products/mindview/webhelp_mv3/user_guide/pen_mode/idhelp_working_in_pen_mode.htm
  30. Windows XP Tablet PC Edition, http://www.microsoft.com/korea/WindowsXP/tabletpc/default.mspx
  31. Motion4, http://documentation.apple.com/en/motion/
  32. J. Kela, P. Korpipaa, J. Mantyjarvi, S. Kallio, G. Savino, L. Jozzo, and S. Marca, "Accelerometer- Based Gesture Control for A Design Environment," PUC, SV Press, 10(5), pp. 285-299, 2006.
  33. M. Nicholson and P. Vickers, "Pen-Based Gesture: An Approach to Reducing Screen Clutter in Mobile Computing," S. Brewster and M. Dunlop (Eds.): MobileHCI , LNCS 3160, pp. 320-324, 2004.
  34. J. Landay and B. Myers, "Sketching Interfaces: Toward More Human Interface Design," IEEE Computer, Vol.34, No.3, pp. 56-64, 2001.
  35. S. Chatty and P. Lecoanet, "Pen Computing for Air Traffic Control," Proc. CHI . ACM Press, pp. 87-94, 1996.
  36. O. Bimber, L. Encarnac, and A. Stork, "A Multi-Layered Architecture for Sketch-Based Interaction Within Virtual Environments," Computer & Graphics 24, pp. 851-867, 2000. https://doi.org/10.1016/S0097-8493(00)00088-1
  37. J. Landay, and B. Myers, "Interactive Sketching for the Early Stages of User Interface Design," Proc. CHI , pp. 45-50, 1995.