Browse > Article
http://dx.doi.org/10.7471/ikeee.2020.24.4.1109

A Quantification Method of Human Body Motion Similarity using Dynamic Time Warping for Keypoints Extracted from Video Streams  

Im, June-Seok (Dept. of Computer Engineering, Seokyeong University)
Kim, Jin-Heon (Dept. of Computer Engineering, Seokyeong University)
Publication Information
Journal of IKEEE / v.24, no.4, 2020 , pp. 1109-1116 More about this Journal
Abstract
The matching score evaluating human copying ability can be a good measure to check children's developmental stages, or sports movements like golf swing and dance, etc. It also can be used as HCI for AR, VR applications. This paper presents a method to evaluate the motion similarity between demonstrator who initiates movement and participant who follows the demonstrator action. We present a quantification method of the similarity which utilizes Euclidean L2 distance of Openpose keypoins vector similarity. The proposed method adapts DTW, thus can flexibly cope with the time delayed motions.
Keywords
Pose Estimation; Pose Comparison; Motion Similarity; Dynamic Time Warping; Motion Delay;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S. H. Back and H. E. Lee, "Effect of motion factor-centered early childhood motion education program on basic motion ability and creativity," KOAECE, Vol.11, No.4, pp.37-60, 2006. DOI: 10.1080/03004430801931196   DOI
2 Chen, Weiming, and Jiang, "Fall Detection Based on Key Points of Human-Skeleton Using OpenPose," Symmetry, Vol.12, No.5, pp.744, 2020. DOI: 10.3390/sym12050744   DOI
3 Naidu, Chetna, and Archana Ghotkar, "Hand gesture recognition using leap motion controller," International Journal of Science and Research (IJSR) ISSN (Online): pp.2319-7064, 2006.
4 Moon, Gyeongsik, Ju Yong Chang, and Kyoung Mu Lee, "V2v-posenet: Voxel-to-voxel prediction network for accurate 3d hand and human pose estimation from a single depth map," Proceedings of the IEEE conference on computer vision and pattern Recognition (CVPR), pp.5079-5088, 2018.
5 Zhi-chao, Cao, and Lingling Zhang, "Key pose recognition toward sports scene using deeply-learned model," Journal of Visual Communication and Image Representation Vol.63, pp.102571, 2019. DOI: 10.1016/j.jvcir.2019.06.013   DOI
6 Chen and Lin, "Hand gesture recognition using compact CNN via surface electromyography signals," Sensors, Vol.20, No.3 pp.672, 2020. DOI: 10.3390/s20030672   DOI
7 Qiao, Sen, Yilin Wang, and Jian Li, "Real-time human gesture grading based on OpenPose," 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI). IEEE, pp.1-6, 2017. DOI: 10.1109/CISP-BMEI.2017.8301910   DOI
8 Cao and Zhe, "OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields," arXiv preprint arXiv:1812.08008, 2018.
9 Senin and Pavel, "Dynamic time warping algorithm review," Information and Computer Science Department University of Hawaii at Manoa Honolulu, Vol.40, No.855, pp.1-23, 2008.
10 Schneider, Memmesheimer, Kramer, and Paulus, "Gesture recognition in RGB videos using human body keypoints and dynamic time warping," In Robot World Cup, pp.37-60, 2019.
11 Muda, Lindasalwa, Mumtaj Begam, and Irraivan Elamvazuthi, "Voice recognition algorithms using mel frequency cepstral coefficient (MFCC) and dynamic time warping (DTW) techniques," arXiv preprint arXiv:1003.4083, 2010.
12 Bala, Anjali, Abhijeet Kumar, and Nidhika Birla, "Voice command recognition system based on MFCC and DTW," International Journal of Engineering Science and Technology, Vol.2. No.12, pp.7335-7342, 2010.
13 Sempena, Samsu, Nur Ulfa Maulidevi, and Peb Ruswono Aryan, "Human action recognition using dynamic time warping," Proceedings of the 2011 International Conference on Electrical Engineering and Informatics, IEEE, pp.1-5, 2011. DOI: 10.1109/ICEEI.2011.6021605   DOI
14 Xiao, Bin, Haiping Wu, and Yichen Wei, "Simple baselines for human pose estimation and tracking," Proceedings of the European conference on computer vision (ECCV). pp.466-481, 2018.
15 Mapari, Rajesh B., and Govind Kharat, "Real time human pose recognition using leap motion sensor," 2015 IEEE International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN), IEEE, pp.323-328, 2015. DOI: 10.1109/ICRCICN.2015.7434258   DOI
16 Doliotis and Paul, "Comparing gesture recognition accuracy using color and depth information," Proceedings of the 4th international conference on PErvasive technologies related to assistive environments, pp.1-7, 2011. DOI: 10.1145/2141622.2141647   DOI
17 Shotton and Jamie, "Real-time human pose recognition in parts from single depth images," CVPR 2011, IEEE, pp.1297-1304, 2011. DOI: 10.1109/CVPR.2011.5995316   DOI
18 Alp Guler, Riza, Natalia Neverova, and Iasonas Kokkinos, "Densepose: Dense human pose estimation in the wild," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.7297-7306, 2018. DOI: 10.1109/CVPR.2018.00762   DOI
19 JIAN and HO CHUN, Gesture recognition using windowed dynamic time warping, Diss, 2010.
20 Muscillo and Rossana, "Early recognition of upper limb motor tasks through accelerometers: real-time implementation of a DTW-based algorithm," Computers in biology and medicine, Vol.41. No.3, pp.164-172, 2011. DOI: 10.1016/j.compbiomed.2011.01.007   DOI