Gesture Recognition by Analyzing a Trajetory on Spatio-Temporal Space

시공간상의 궤적 분석에 의한 제스쳐 인식

  • Published : 1999.01.01

Abstract

Researches on the gesture recognition have become a very interesting topic in the computer vision area, Gesture recognition from visual images has a number of potential applicationssuch as HCI (Human Computer Interaction), VR(Virtual Reality), machine vision. To overcome thetechnical barriers in visual processing, conventional approaches have employed cumbersome devicessuch as datagloves or color marked gloves. In this research, we capture gesture images without usingexternal devices and generate a gesture trajectery composed of point-tokens. The trajectory Is spottedusing phase-based velocity constraints and recognized using the discrete left-right HMM. Inputvectors to the HMM are obtained by using the LBG clustering algorithm on a polar-coordinate spacewhere point-tokens on the Cartesian space .are converted. A gesture vocabulary is composed oftwenty-two dynamic hand gestures for editing drawing elements. In our experiment, one hundred dataper gesture are collected from twenty persons, Fifty data are used for training and another fifty datafor recognition experiment. The recognition result shows about 95% recognition rate and also thepossibility that these results can be applied to several potential systems operated by gestures. Thedeveloped system is running in real time for editing basic graphic primitives in the hardwareenvironments of a Pentium-pro (200 MHz), a Matrox Meteor graphic board and a CCD camera, anda Window95 and Visual C++ software environment.

Keywords

References

  1. IEEE Trans. On PAMI v.19 no.7 Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review V.I.Pavlovic;R.Sharma;T.S.Huang
  2. Proceedings of SMC'97 Hand Gesture Recognition Using Hidden Markov Models B.W.Min;H.S.Yoon;J.Soh;Y.M.Yang;T.Ejima
  3. Proceedings of International Workshop of Face- and Gesture-Recognition Visual Recognition of American Sign Language Using Hidden Markov Models Stadner;A. Pentland
  4. Proceedings of SMC'97 Adapting Hidden Markov Models for ASL Recognition by Using Tree-dimensional Computer Vision Methods C.Volger;D.Metaxas
  5. Proceedings of SMC'97 Isolated Sign Language Recognition Using Hidden Markov Models K.Grobel;M.Assan
  6. Proceedings of the Second Conference on Automatic Face and Gesture Recognition Gestural Interface to a Visual Computing Environment for Molecular Biologists V.I.Pavlovic;R.Sharma;T.H.Huang
  7. IEEE Spectrum v.30 no.10 Visual Reality J.A.Adam
  8. Proceedings of International Workshop of Face- and Gesture-Recognition Television Control by Hand Gestrures W.T.Freeman;C.D.Weissman
  9. Proceedings of the Second Conference on Automatic Face and Gesture Recognition Dynamical System Representation, Generation, and Recognition of Basic Oscillatory Motion Gestures C.J.Cohen;L.Conway;D.Koditschek
  10. Proceedings of International Workshop of Face- and Gesture-Recognition Visual Recognition for Windows R.Kjeldsen;J.Kender
  11. International Journal of Man-Machine Studies v.38 Gesture with Speech for Graphics Manipulation A.G.Hauptman;P.McAvinney
  12. Technical Report of IEIEC v.PRU94-52 Hand Structure Recognition Using Color Information K.Yoshino;M.Maki;T.Kawashima;Y.Aoki
  13. International Journal of Computer Vision Color Indexing M.J.Swain;D.H.Ballard
  14. IEEE Transaction on Systems, Man and Cybernetics v.SMC-9 A Threshold Selection Method from Gray-Level Histogram N.Otsu
  15. Proceedings of Virtual Reality Software and Technology Conference Toward a Vision-Based Hand Gesture Interface F.Queck
  16. The Biological Foundations of Gestures: Motor and Semiotic Aspects Current Issues in the Study of Gesture A.Kendon;J.-L.Nespoulos;P.Peron;A.R.Lecours (eds.)
  17. Proceedings of Korean HCI Conference PowerGesture: Presentation Supporting System using Gesture Spotting H.K.Lee;J.H.Kim
  18. Proceedings of MIRU96 v.2 A Proposal of Pattern Trajectory for Gesture Spotting Recognition S.Nagaya;S.Seki;R.Oka;T.Mukai
  19. Hidden Markov Models for Speech Recognition X.D.Huang;Y.Ariki;M.A.Jack