Browse > Article

An Efficient Analysis Method of Multiple View Images for Motion Capture  

Seo, Yung-Ho (Dept. of Image Engineering, GSAIM, Chung-Ang University)
Park, You-Shin (Dept. of Image Engineering, GSAIM, Chung-Ang University)
Koo, Ddeo-Ol-Ra (Dept. of Image Engineering, GSAIM, Chung-Ang University)
Doo, Kyoung-Soo (Dept. of Image Engineering, GSAIM, Chung-Ang University)
Choi, Jong-Soo (Dept. of Image Engineering, GSAIM, Chung-Ang University)
Publication Information
Abstract
Previous hardware devices to capture human motion have many limitations; expensive equipment, complexity of manipulation or constraints of human motion. In order to overcome these problems, real-time motion capture algorithms based on computer vision have been actively proposed. This paper presents an efficient analysis method of multiple view images for real-time motion capture. First, we detect the skin color regions of human being, and then correct the image coordinates of the regions by using camera calibration and epipolar geometry. Finally, we track the human body part and capture human motion using kalman filter. Experimental results show that the proposed algorithm can estimate a precise position of the human body.
Keywords
Motion capture; Epipolar geometry; Camera calibration; 3D reconstruction; Kalman Filter;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 R. Poppe, "Vision-based human motion analysis: An overview," Int. J. Computer Vision and Image Understanding, Vol. 108, Issues 1-2, pp. 4-18, 2007   DOI   ScienceOn
2 G. Rogez,, C. Orrite-Urunuela, and J. Martinez del Rincon, "A spatio-temporal 2D-models framework for human pose recovery in monocular sequences," Pattern Recognition, Vol. 41, pp. 2926-2944,, 2008   DOI   ScienceOn
3 N. Date, H. Yoshimoto, D. Arita, R. I. Taniquchi, "Real-time Human Motion Sensing based on Vision-based Inverse Kinematics for Interactive Applications," Int. Conf. on Pattern Recognition, Vol. 3, pp. 318-321, Aug. 2004
4 L. Sigal, S. Sclaroff, V. Athitsos, "Estimation and Prediction of Evolving Color Distributions for Skin Segmentation Under Varying Illumination," IEEE Conf. on Computer Vision and Pattern Recognition, Vol. 2, pp. 152-159, June. 2000
5 S. K. Singh, D. S. Chauhan, M. Vatsa, R. Singh, "A Robust Skin Color Based Face Detection Algorithm," Tamkang J. of Science and Engineering, Vol. 6, No. 4, pp. 227-234, 2003
6 C. Smininchisescu, A. Telea, "Human pose Estimation From Silhouette: A Consistent Approach Using Distanace Level Sets," Int. Conf. on Computer Graphics, Visualization and Computer Vision, 2002
7 G. Welch, G. Bishop, "An Introduction to the Kalman Filter," UNC-Chapel Hill, TR 95-041, July, 2006
8 S. E. Kim, C. J. Park, I. H. Lee, "A Tracking Method of End-effectors in a Vision-based Marker-free Motion Capture System," Int. Conf. on Cybernatics and Intelligent Systems, pp. 129-134, Dec. 2004
9 A. Agarwal, B. Triggs, "Recovering 3D Human Pose from Monocular Images," IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 28, No. 1, pp. 44-58, Jan. 2006   DOI   ScienceOn
10 R. Hartley, A. Zisserman, "Multiple View Geometry," Cambridge Univ. Press, 2000
11 A. Sundaresan, R. Chellappa, "Model driven segmentation of articulating humans in Laplacian Eigenspace," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 30, Issue 8, 2008
12 E. Aguiar, C. Theobalt, C. Stoll, H. P. Seidel, "Marker-less 3D Feature Tracking for Mesh-based Human Motion Capture," Workshop on Human Motion, LNCS 4814, pp. 1-15, 2007
13 Y. H. Seo, S. H. Kim, K. S. Doo, J. S. Choi, "Optimal keyframe selection algorithm for three-dimensional reconstruction in uncalibrated multiple images," Optical Engineering, Vol. 47, Issue 5, May, 2008
14 이민기, 박성규, 박근표, 양선우, 이범렬, "모션캡처 기술 동향," 전자통신동향분석, 제22권, 제4호, 2007
15 T. B. Moeslund, A. Hilton, V. Kruger, "A survey of advances in vision-based human motion capture and analysis," Int. J. Computer Vision and Image Understaning, Vol. 104, Issues 2-3, pp. 90-126, 2006   DOI   ScienceOn
16 Q. Zhu, C. T. Wu, K. T. Cheng, Y. L. Wu, "An Adaptive Skin Model and Its Application to Objectionable Image Filtering," ACM Int. Conf. on Multimedia, pp. 56-63, Oct. 2004
17 T. Chaichana, M. Sangworasil, C. Pintavisrooj, S. Aootaphao, "Acclerate a Dlt Motion Capture System With Quad-Tree Searching Scheme," Int. Sym. on Communications and Information Technologies, pp. 1035-1038, Oct. 2006
18 한윤상, 서융호, 두경수, 김진태, 최종수, "실세계 3차원 기하학 정보를 이용한 지시영역 추정 시스템의 구현 및 응용," 대한전자공학회논문지, 제45권 SP편 제2호, 2008년 3월   과학기술학회마을
19 F. Guo, G. Qian, "Human Pose Inference from Stereo Cameras," IEEE Workshop on Applications of Computer Vision, pp. 37-37, Feb. 2007
20 M. W. Lee, R. Nevatia, "Integrating Component Cues for Human Pose Tracking," Int Workshop on VS-PETS, pp. 41-48, Oct. 2005
21 J. Heikkila, O. Silven, "A Four-step Camera Calibration Procedure with Implicit Image Correction," IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1106-1112, Jun. 1997
22 H. Ohbuch, J. K. Tan, S. Ishikawa, "Reconvering Human Actions Using Eigenspace," Int. Joint Conf. SICE-ICASE, pp. 2698-2701, Oct. 2006
23 J. Yang, W. Lu, A. Waibel, "Skin-Color Modeling and Adaptation," Asian Conf. on Computer Vision, Vol. 2, pp. 687-694, Jan. 1998
24 Z. Zhang, "A flexible new technique for camera calibration," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 22, No. 11, 1330-1334, 2000   DOI   ScienceOn
25 P. Azad, A. Ude, T. Asfour, G. Cheng, and R. Dillmann, "Stereo-based Markerless Human Motion Capture for Humanoid Robot Systems," IEEE Int. Conf. on Robotics and Automation, pp. 3951-3956, April, 2007