Browse > Article
http://dx.doi.org/10.15701/kcgs.2017.23.2.41

Motion correction captured by Kinect based on synchronized motion database  

Park, Sang Il (Department of Software, Sejong University)
Publication Information
Journal of the Korea Computer Graphics Society / v.23, no.2, 2017 , pp. 41-47 More about this Journal
Abstract
In this paper, we present a method for data-driven correction of the noisy motion data captured from a low-end RGB-D camera such as the Kinect device. For this purpose, our key idea is to construct a synchronized motion database captured with Kinect and additional specialized motion capture device simultaneously, so that the database contains a set of erroneous poses from Kinect and their corresponding correct poses from the mocap device together. In runtime, given motion captured data from Kinect, we search the similar K candidate Kinect poses from the database, and synthesize a new motion only by using their corresponding poses from the mocap device. We present how to build such motion database effectively, and provide a method for querying and searching a desired motion from the database. We also adapt the laze learning framework to synthesize the corrected poses from the querying results.
Keywords
Motion correction; Motion capture; Character animation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Z. Gao, Y. Yu, Y. Zhou, and S. Du. "Leveraging two kinect sensors for accurate full-body motion capture." Sensors 15, no. 9, 2015.
2 J. Rosado, F. Silva, V. Santos, and Z. Lu. "Reproduction of human arm movements using Kinect-based motion capture data." In Robotics and Biomimetics (ROBIO), 2013 IEEE International Conference on, pp. 885-890, 2013.
3 A. Hadjakos, "Pianist motion capture with the Kinect depth camera," Proceedings of the Sound and Music Computing Conference , pp. 303-310, 2012.
4 J. Rosado, S. Silva, and V. Santos. "A Kinect-based motion capture system for robotic gesture imitation." In ROBOT2013: First Iberian Robotics Conference, pp. 585-595, 2014.
5 T. Moeslund and E. Granum. "A survey of computer vision-based human motion capture." Computer vision and image understanding 81, no. 3, pp. 231-268, 2001.   DOI
6 J. Bray, "Markerless based human motion capture: a survey." Department Systems Engineering Brunel University, 2001.
7 KINECT, https://developer.microsoft.com/en-us/windows/kinect, Microsoft Kinect for Xbox 360, 2012
8 A. Baak, M. Muller, G. Bharaj, H. Seidel, and C. Theobalt. "A data-driven approach for real-time full body pose reconstruction from a depth camera." In Consumer Depth Cameras for Computer Vision, pp. 71-98. 2013.
9 J. Shotton, T. Sharp, A. Kipman, A. Fitzgibbon, M. Finocchio, A. Blake, M. Cook, and R. Moore. "Real-time human pose recognition in parts from single depth images." Communications of the ACM 56, no. 1, pp. 116-124, 2013.   DOI
10 CMU Motion Capture Database, http://mocap.cs.cmu.edu/, 2017.
11 C. Chen, R. Jafari, and N. Kehtarnavaz. "A survey of depth and inertial sensor fusion for human action recognition." Multimedia Tools and Applications, pp.1-21, 2015.
12 Xsens Motion Tracking, http://xsens.com/, 2017.
13 J. Lee and S. Shin, General Construction of Time-Domain Filters for Orientation Data, IEEE Transactions on Visualization and Computer Graphics, volume 8, number 2, pp. 119-128, 2002.   DOI
14 J. Chai and J. Hodgins, Performance Animation from Lowdimensional Control Signals, In Proceedings of ACM SIGGRAPH 2005, pp. 686-696, 2005.