ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Human Activity Recognition Using Body Joint-Angle Features and Hidden Markov Model

  • Uddin, Md. Zia (Department of Biomedical Engineering, Kyung Hee University) ;
  • Thang, Nguyen Duc (Department of Computer Engineering, Kyung Hee University) ;
  • Kim, Jeong-Tai (Department of Architectural Engineering, Kyung Hee University) ;
  • Kim, Tae-Seong (Department of Biomedical Engineering, Kyung Hee University)
  • Received : 2010.06.02
  • Accepted : 2011.02.07
  • Published : 2011.08.30
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents a novel approach for human activity recognition (HAR) using the joint angles from a 3D model of a human body. Unlike conventional approaches in which the joint angles are computed from inverse kinematic analysis of the optical marker positions captured with multiple cameras, our approach utilizes the body joint angles estimated directly from time-series activity images acquired with a single stereo camera by co-registering a 3D body model to the stereo information. The estimated joint-angle features are then mapped into codewords to generate discrete symbols for a hidden Markov model (HMM) of each activity. With these symbols, each activity is trained through the HMM, and later, all the trained HMMs are used for activity recognition. The performance of our joint-angle-based HAR has been compared to that of a conventional binary and depth silhouette-based HAR, producing significantly better results in the recognition rate, especially for the activities that are not discernible with the conventional approaches.

Keywords

References

  1. J. Yamato, J. Ohya, and K. Ishii, "Recognizing Human Action in Time-Sequential Images using Hidden Markov Model," IEEE Int. Conf. Comput. Vision Pattern Recognition, 1992, pp. 379-385.
  2. S. Carlsson and J. Sullivan, "Action Recognition by Shape Matching to Key Frames," IEEE Comput. Soc. Workshop on Models Versus Exemplars in Comput. Vision, 2002, pp. 263-270.
  3. F. Niu and M. Abdel-Mottaleb, "View-Invariant Human Activity Recognition Based on Shape and Motion Features," IEEE 6th Int. Symp. Multimedia Software Eng., 2004, pp. 546-556.
  4. M.Z. Uddin, J.J. Lee, and T.-S. Kim, "Independent Shape Component-Based Human Activity Recognition via Hidden Markov Model," Appl. Intellig., vol. 33, no. 2, 2009, pp. 193-206.
  5. M.Z. Uddin et al., "Human Activity Recognition Using Independent Component Features from Depth Images," 5th Int. Conf. Ubiquitous Healthcare, 2008, pp. 181-183.
  6. T.B. Moeslund and E. Granum, "A Survey of Computer Vision- Based Human Motion Capture," Comput. Vision and Image Understanding, vol. 81, no. 3, 2001, pp. 231-268. https://doi.org/10.1006/cviu.2000.0897
  7. M.W. Lee and R. Nevatia, "Human Pose Tracking in Monocular Sequence Using Multilevel Structured Models" IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 1, 2009, pp. 27-38. https://doi.org/10.1109/TPAMI.2008.35
  8. C. Chen et al., "3D Human Pose Recovery from Image by Efficient Visual Feature Selection," Comput. Vision Image Understanding, vol. 115, no. 3, 2010, pp. 290-299.
  9. I. Chang and S.-Y. Lin, "3D Human Motion Tracking Based on a Progressive Particle Filter," Pattern Recognition, vol. 43, no. 10, 2010, pp. 3621-3635. https://doi.org/10.1016/j.patcog.2010.05.003
  10. P.R. Horaud et al., "Human Motion Tracking by Registering an Articulated Surface to 3D Points and Normals," IEEE Trans. Pattern Anal. Machine Intell., vol. 31, no. 1, 2009, pp. 158-164. https://doi.org/10.1109/TPAMI.2008.108
  11. L. Sigal L, A.O. Balan, and M.J. Black, "HUMANEVA: Synchronized Video and Motion Capture Dataset and Baseline Algorithm for Evaluation of Articulated Motion," Int. J. Comput. Vision, vol. 87, no. 1-2, 2010, pp. 4-27. https://doi.org/10.1007/s11263-009-0273-6
  12. N.D. Thang et al., "Estimation of 3-D Human Body Posture via Co-Registration of 3-D Human Model and Sequential Stereo Information," Applied Intell., DOI: 10.1007/s10489-009-0209-4, 2010.
  13. J. Cech and R. Sara, "Efficient Sampling of Disparity Space for Fast and Accurate Matching," IEEE Conf. Comput. Vision Pattern Recognition, 2007, pp. 1-8.
  14. P. Viola and M.J. Jones, "Robust Real-Time Face Detection," Int. J. Comput. Vision, vol. 57, no. 2, 2004, pp. 137-154. https://doi.org/10.1023/B:VISI.0000013087.49260.fb
  15. D. Comaniciu, V. Ramesh, and P. Meer, "Kernel-Based Object Tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 5, 2003, pp. 564-577. https://doi.org/10.1109/TPAMI.2003.1195991
  16. B. Ristic, S. Arulampalam, and N. Gordon, Beyond the Kalman Filter: Particle Filters for Tracking Applications, Artech House, 2004.
  17. Y. Boykov, O. Veksler, and R. Zabih, "Fast Approximate Energy Minimization via Graph Cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 11, 2001, pp. 1222-1239. https://doi.org/10.1109/34.969114
  18. E.W. Djikstra, "A Note on Two Problems in Connexion with Graphs," Numerische Mathematik, vol. 1, 1959, pp. 269-271. https://doi.org/10.1007/BF01386390
  19. T. Toyoda and O. Hasegawa, "Random Field Model for Integration of Local Information and Global Information," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 8, 2008, pp. 1483- 1489. https://doi.org/10.1109/TPAMI.2008.105
  20. M.Z. Uddin, J.J. Lee, and T.-S. Kim, "An Enhanced Independent Component-Based Human Facial Expression Recognition from Video," IEEE Trans. Consum. Electron., vol. 55, no. 4, 2009, pp. 2216-2224. https://doi.org/10.1109/TCE.2009.5373791
  21. Y. Linde, A. Buzo, and R. Gray, "An Algorithm for Vector Quantizer Design," IEEE Trans. Commun., vol. 28, no. 1, 1980, pp. 84-95. https://doi.org/10.1109/TCOM.1980.1094577

Cited by

  1. Action performance evaluation in video sequences vol.62, pp.7, 2014, https://doi.org/10.1179/1743131x13y.0000000065
  2. Particle Swarm Optimization Using Adaptive Boundary Correction for Human Activity Recognition vol.8, pp.6, 2011, https://doi.org/10.3837/tiis.2014.06.015
  3. 시점 불변인 특징과 확률 그래프 모델을 이용한 인간 행위 인식 vol.41, pp.11, 2011, https://doi.org/10.5626/jok.2014.41.11.927
  4. Human Activity Recognition as Time-Series Analysis vol.2015, pp.None, 2015, https://doi.org/10.1155/2015/676090
  5. 동작인식을 이용한 탁구 스윙 분석 vol.21, pp.1, 2011, https://doi.org/10.5302/j.icros.2015.14.0078
  6. Human Activity Recognition Using Spatiotemporal 3-D Body Joint Features with Hidden Markov Models vol.10, pp.6, 2011, https://doi.org/10.3837/tiis.2016.06.017
  7. Human Activity Recognition Based-on Conditional Random Fields with Human Body Parts vol.10, pp.4, 2016, https://doi.org/10.3923/jse.2016.408.415
  8. 3-D human pose recovery using nonrigid point set registration and body part tracking of depth data vol.23, pp.3, 2011, https://doi.org/10.1007/s00530-015-0497-y
  9. Combining discriminative spatiotemporal features for daily life activity recognition using wearable motion sensing suit vol.20, pp.4, 2011, https://doi.org/10.1007/s10044-016-0558-7
  10. Understanding Human Action using a Bayesian HMM with a Continuous Gaussian-Wishart Emission Model vol.7, pp.2, 2018, https://doi.org/10.5573/ieiespc.2018.7.2.132
  11. Joint-angle-based yoga posture recognition for prevention of falls among older people vol.53, pp.4, 2011, https://doi.org/10.1108/dta-03-2019-0041
  12. Syntactic model-based human body 3D reconstruction and event classification via association based features mining and deep learning vol.7, pp.None, 2021, https://doi.org/10.7717/peerj-cs.764
  13. Syntactic model-based human body 3D reconstruction and event classification via association based features mining and deep learning vol.7, pp.None, 2021, https://doi.org/10.7717/peerj-cs.764
  14. Unsupervised Learning for Product Use Activity Recognition: An Exploratory Study of a “Chatty Device” vol.21, pp.15, 2021, https://doi.org/10.3390/s21154991