Robust 3D Hand Tracking based on a Coupled Particle Filter

결합된 파티클 필터에 기반한 강인한 3차원 손 추적

  • Published : 2010.01.15

Abstract

Tracking hands is an essential technique for hand gesture recognition which is an efficient way in Human Computer Interaction (HCI). Recently, many researchers have focused on hands tracking using a 3D hand model and showed robust tracking results compared to using 2D hand models. In this paper, we propose a novel 3D hand tracking method based on a coupled particle filter. This provides robust and fast tracking results by estimating each part of global hand poses and local finger motions separately and then utilizing the estimated results as a prior for each other. Furthermore, in order to improve the robustness, we apply a multi-cue based method by integrating a color-based area matching method and an edge-based distance matching method. In our experiments, the proposed method showed robust tracking results for complex hand motions in a cluttered background.

손 추적 기술은 인간과 기계와의 효율적인 의사소통을 위한 손동작 인식 기술의 핵심 기반 기술이다. 최근의 손 추적 연구는 3차원 손 모델을 이용한 연구 방향에 초점을 맞추고 있고, 기존의 2차원 손 모델을 이용한 방법보다 강인한 추적 성능을 보이고 있다. 본 논문에서는 결합된 파티클 필터에 기반한 새로운 3차원 손 추적 방법을 제안한다. 이는 전역적 손 형상과 지역적 손가락 움직임을 분리하여 추정하고, 각각의 추정 결과를 서로의 사전 정보로 이용하여 기존의 방법보다 빠르고 강인한 추적을 가능하게 한다. 또한, 추적 성능 향상을 위해 색상과 에지를 함께 고려한 다중 증거 결합 방법을 적용한다. 실험결과, 제안하는 방법은 복잡한 배경이나 동작에서도 강인한 추적 결과를 보였다.

Keywords

References

  1. B. Stenger, A. Thayananthan, P. Torr, and R. Cipolla, "Model-based Hand Tracking using a Hierarchical Bayesian Filter," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.28, no.9, pp.1372-1384, 2006.
  2. M. Bray, E. Meier, and L. Gool, "Smart Particle Filtering for High-Dimensional Tracking," Computer Vision and Image Understanding, vol.106, no.1, pp.116-129, 2007. https://doi.org/10.1016/j.cviu.2005.09.013
  3. J. Maccormick and M. Isard, "Partitioned Sampling, Articulated Objects, and Interface Quality Hand Tracking," Proc. European Conference on Computer Vision, Dublin, Ireland, pp.3-19, 2000.
  4. Y. Wu, J. Lin, and T. Huang, "Analyzing and Capturing Articulated Hand Motion in Image Sequences," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.27, no.12, pp.1910-1922, 2005. https://doi.org/10.1109/TPAMI.2005.233
  5. M. Isard and A. Blake, "CONDENSATION - Conditional Density Propagation for Visual Tracking," International Journal of Computer Vision, vol.29, no.1, pp.5-28, 1998. https://doi.org/10.1023/A:1008078328650
  6. J. Lin, Y. Wu, and T. Huang, "Modeling the Constraints of Human Hand Motion," Proc. Workshop on Human Motion, Texas, USA, pp.121-126, 2000.
  7. F. Chen, C. Fu, and C. Huang, "Hand Gesture Recognition Using a Real-time Tracking Method and Hidden Markov Models," Image and Vision Computing, vol.21, no.8, pp.745-758, 2003. https://doi.org/10.1016/S0262-8856(03)00070-2
  8. A. Argyros and M. Lourakis, "Real Time Tracking of Multiple Skin Colored Objects with a Possibly Moving Camera," European Conference on Computer Vision, Prague, Czech Republic, pp. 368-379, 2004.
  9. G. Borgefors, "Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.10, no.6, pp.849-865, 1988. https://doi.org/10.1109/34.9107
  10. J. Kovac, P. Peer, and F. Solina, "Human Skin Color Clustering for Face Detection," Proc. The IEEE Region 8 EUROCON 2003: Computer as a Tool, pp.144-148, 2003.
  11. http://sourceforge.net/projects/opencvlibrary/
  12. http://www.opengl.org/resources/libraries/