Browse > Article

Motion Capture using both Human Structural Characteristic and Inverse Kinematics  

Seo, Yung-Ho (School of Electronics and Computer Engineering, Chonnam National University)
Doo, Kyoung-Soo (Dept. of Image Engineering, Graduate School of Advanced Image Science, Multimedia, and film, Chung-Ang University)
Choi, Jong-Soo (Dept. of Image Engineering, Graduate School of Advanced Image Science, Multimedia, and film, Chung-Ang University)
Lee, Chil-Woo (School of Electronics and Computer Engineering, Chonnam National University)
Publication Information
Abstract
Previous hardware devices to capture human motion have many limitations; expensive equipment, complexity of manipulation or constraints of human motion. In order to overcome these problems, real-time motion capture algorithms based on computer vision have been actively proposed. This paper presents an efficient analysis method of multiple view images for real-time motion capture. First, we detect the skin color regions of human being, and then correct the image coordinates of the regions by using camera calibration and epipolar geometry. Finally, we track the human body part and capture human motion using kalman filter. Experimental results show that the proposed algorithm can estimate a precise position of the human body.
Keywords
Motion capture; Epipolar geometry; Camera calibration; 3D reconstruction; Kalman Filter;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 R. Hartley, A. Zisserman, "Multiple View Geometry," Cambridge University Press, 2000.
2 http://www.xbox.com/en-US/live/projectnatal/
3 A. Agarwal, B. Triggs, "Recovering 3D Human Pose from Monocular Images," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 28, No. 1, pp. 44-58, Jan. 2006.   DOI
4 P. Correa, J. Czyz, F. Marques, T. Umeda, X. Marichal, B. Macq, "Bayesian Approach for Morphology-Based 2-D Human Motion Capture," IEEE Trans. on Multimedia, Vol. 9, No. 4, pp. 754-765, June, 2007.   DOI
5 A. Sundaresan, R. Chellappa, "Model Driven Segmentation of Articulating Humans in Laplacian Eigenspace," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 30, No. 10, pp. 1771-1785, Oct. 2008.   DOI
6 P. Peer, J. Kovac, F. Solina, "Human skin colour clustering for face detection," IEEE Conf. on Computer as a Tool EUROCON2003, Vol. 2, pp. 144-148, Sept. 2003.
7 http://www.nbb.cornell.edu/neurobio/land/OldStudentProjects/cs490-97to98/yen/
8 S. E. Kim, C. J. Park, I. H. Lee, "A Tracking Method of End-effectors in a Vision-based Marker-free Motion Capture System," Int. Conf. on Cybernatcis and Intelligent Systems, pp. 129-134, Dec. 2004.
9 H. Ohbuch, J. K. Tan, S. Ishikawa, "Recovering Huamn Actions using Eigenspace," Int. Joint Conf. on Society of Instrument and Control Engineers/Institute of Control, Aumation and System Engineers, pp. 2698-2701, Oct. 2006.
10 D. Tolani, A. Goswami, N. I. Badler, "Real-time Inverse Kinematics Techniques for anthropomorphic limbs," Graphical Models and Image Processing, Vol. 62, Issues 5, pp. 353-388, Sept. 2000.   DOI   ScienceOn
11 이민기, "디지털 3D애니메이션지원을 위한 첨단영상제작장비 활용방안 연구," 세종대학교 영상대학원, 2003.
12 M. Tong, Y. Liu, T. S. Huang, "3D Human Model and Joint Parameter Estimation from Monocular Image," Pattern Recognition Letters, Vol. 28, No. 7, pp. 797-805, May, 2007.   DOI   ScienceOn
13 J. U. Korein, N. I. Balder, "Techniques for Generating the Goal-Directed Motion of Articulated Structures," IEEE Computer Graphics and Applications, Vol. 2, Issues 9, pp. 71-81, Nov. 1982.
14 C. Smininchisescu, A. Telea, "Human Pose Estimation from Silhouette: A Consistent Approach Using Distance Level Sets," Int. Conf. on Computer Graphics, Visualization and Computer Vision, 2002.
15 A. Menache, "Understanding Motion Capture for Computer Animation and Video Games," Morgan Kaufmann Publishers, 2000.
16 Y. Kameda, "Human Pose and Motion Estimation with a Three Dimensional Articulated Object Model," Ph. D. dissertation, Kyoto University, Kyoto, 1999.
17 M. W. Lee, R. Nevatia, "Integrating Component Cues for Human Pose Tracking," Int. Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, pp. 41-48, Oct. 2005.
18 T. Chaichana, M. Sangworasil, C. Pintavisrooj, S. Aootaphao, "Accelerate a Dlt Motion Capture System with Quad-Tree Searching Scheme," Int. Sym. on Communications and Information Technologies, pp. 1035-1038, Oct. 2006.
19 W. H. Press, S. A. Teukolosky, W. T. Vetterling, B. P. Flannery, "Numerical Recipes in C++," Cambridge University Press, 2002.
20 R. Poppe, "Vision-based human motion analysis: An overview," Int. J. Computer Vision and Image Understanding, Vol. 108, Issues 1-2, pp. 4-18, 2007.   DOI   ScienceOn
21 서융호, 박유신, 구떠올라, 두경수, 최종수, "모션 캡처를 위한 다시점 영상의 효율적인 분석법," 대한전자공학회논문지, 제45권 SP편 제6호, pp. 44-56, 2008년 11월.
22 F. Guo, G. Qian, "Human Pose Inference from Stereo Cameras," IEEE Workshop on Applications of Computer Vision, pp. 37-37, Feb. 2007.
23 T. B. Moreslund, A. Hilton, V. Kruger, "A survey of advances in vision-based human motion capture and analysis," Int. J. Computer Vision and Image Understanding, Vol. 104, Issues 2-3, pp. 90-126, 2006.   DOI   ScienceOn
24 이민기, 박성규, 박근표, 양선우, 이범렬, "모션캡처 기술 동향," ETRI-전자통신동향분석, 제22권, 제4호, 2007.