Browse > Article
http://dx.doi.org/10.15701/kcgs.2017.23.5.67

Real-time user motion generation and correction using RGBD sensor  

Gu, Tae Hong (Hanyang University)
Kim, Un Mi (Hanyang University)
Kim, Jong Min (Kangwon National University)
Kwon, Tae Soo (Hanyang University)
Publication Information
Journal of the Korea Computer Graphics Society / v.23, no.5, 2017 , pp. 67-73 More about this Journal
Abstract
We propose several techniques which can be employed in a 3D fitness program for monitoring and correcting user's posture. To implement a 3D fitness program, improved reference motion generating techniques and visualizing techniques are necessary. First, in order to understand the difference between the user and the reference movement of a professional, a retargeting method between two different body shapes are studied. Second, the problem of self-occlusion, which occurs when using a low-cost depth sensor to represent complex motions, is solved by using a sample database and time consistency. The system proposed in this paper evaluates the user's posture considering the physical characteristics of the user, and then provides feedback to the user.
Keywords
RGBD Sensor; Retargeting; Data interpolation; Pose tracking;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Park, Sang Il, and Jessica K. Hodgins. "Capturing and animating skin deformation in human motion." ACM Transactions on Graphics (TOG). Vol. 25. No. 3. ACM, 2006.
2 De Aguiar, Edilson, et al. "Marker-less deformable mesh tracking for human shape and motion capture." Computer Vision and Pattern Recognition, 2007. CVPR'07. IEEE Conference on. IEEE, 2007.
3 Badler, Norman I., Michael J. Hollick, and John P. Granieri. "Real-Time control of a virtual human using minimal sensors." (1993).
4 Lee, Jehee, et al. "Interactive control of avatars animated with human motion data." ACM Transactions on Graphics (TOG). Vol. 21. N0. 3. ACM, 2002.
5 Chai, Jinxiang, and Jessica K. Hodgins. "Performance animation from low dimensional control signals." ACM Transactions on Graphics (TOG). Vol. 24. No. 3. ACM, 2005.
6 Vlasic, Daniel, et al. "Articulated mesh animation from multi-view silhouettes." ACM Transactions on Graphics (TOG). Vol. 27. No. 3. ACM, 2008.
7 Loper, Matthew, Naureen Mahmood, and Michael J. Black. "MoSh: motion and shape capture from sparse markers." ACM Transactions on Graphics (TOG) 33.6 (2014) 220.
8 Shotton, Jamie, et al. "Real-time human pose recognition in parts from single depth images." Communications of the ACM 56.1 (2013): 116-124.   DOI
9 Baak, Andreas, et al. "A data-driven approach for real-time full body pose reconstruction from a depth camera." Consumer Depth Cameras for Computer vision. Springer London, 2013. 71-98.
10 Caillette, Fabrice, Aphrodite Galata, and Toby Howard. "Real-Time 3-D Human Body Tracking using Variable Length Markov Models." BMVC. 2005.
11 Kwok, Tsz-Ho, Kwok-Yun Yeung, and Charlie CL Wang. "Volumetric Template Fitting for Human Body Reconstruction from Incomplete Data." Journal of Manufacturing Systems 33.4 (2014): 678-689.   DOI
12 P. J. Besl and N. D. McKay, "A method for registration of 3-D shapes," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 239-256, Feb. 1992.   DOI
13 Yang Chen, Gerard Medioni, Object modelling by registration of multiple range images, In Image and Vision Computing, Volume 10, Issue 3, 1992, Pages 145-155, ISSN 0262-8856   DOI