ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Automated Markerless Analysis of Human Gait Motion for Recognition and Classification

  • Yoo, Jang-Hee (Software Research Laboratory, ETRI) ;
  • Nixon, Mark S. (School of Electronics and Computer Science, University of Southampton)
  • Received : 2010.03.10
  • Accepted : 2010.10.04
  • Published : 2011.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

We present a new method for an automated markerless system to describe, analyze, and classify human gait motion. The automated system consists of three stages: I) detection and extraction of the moving human body and its contour from image sequences, ii) extraction of gait figures by the joint angles and body points, and iii) analysis of motion parameters and feature extraction for classifying human gait. A sequential set of 2D stick figures is used to represent the human gait motion, and the features based on motion parameters are determined from the sequence of extracted gait figures. Then, a k-nearest neighbor classifier is used to classify the gait patterns. In experiments, this provides an alternative estimate of biomechanical parameters on a large population of subjects, suggesting that the estimate of variance by marker-based techniques appeared generous. This is a very effective and well-defined representation method for analyzing the gait motion. As such, the markerless approach confirms uniqueness of the gait as earlier studies and encourages further development along these lines.

Keywords

References

  1. V.T. Inman, H.J. Ralston, and F. Todd, Human Walking, Baltimore: Williams & Wilkins, 1981.
  2. D.A. Winter, The Biomechanics and Motor Control of Human Gait: Normal, Elderly and Pathological, Ontario: Waterloo Biomechanics, 1991.
  3. M.S. Nixon, T. Tan, and R. Chellappa, Human Identification Based on Gait, Springer, 2006.
  4. M.K. Leung and Y.H. Yang, "First Sight: A Human Body Outline Labeling System," IEEE Trans. Pattern Anal. Mach. Intell., vol. 17, no. 4, 1995, pp.359-377. https://doi.org/10.1109/34.385981
  5. J. Perry, Gait Analysis: Normal and Pathological Function, NJ: Slack, 1992.
  6. G. Johansson, "Visual Perception of Biological Motion and a Model for Its Analysis," Perception and Psychophysics, vol. 14, no. 2, 1973, pp. 201-211. https://doi.org/10.3758/BF03212378
  7. S.V. Stevenage, M.S. Nixon, and K. Vince, "Visual Analysis of Gait as a Cue to Identity," Applied Cognitive Psychology, vol. 13, 1999, pp. 513-526. https://doi.org/10.1002/(SICI)1099-0720(199912)13:6<513::AID-ACP616>3.0.CO;2-8
  8. M.P. Murray, A.B. Drought, and R.C. Kory, "Walking Patterns of Normal Men," J. Bone and Joint Surgery, vol. 46A, no. 2, 1964, pp. 335-360.
  9. C.W. Cho et al., "A Vision-Based Analysis System for Gait Recognition in Patients with Parkinson's Disease," Expert Syst. with Appl., vol. 36, no. 3, Apr. 2009, pp. 7033-7039. https://doi.org/10.1016/j.eswa.2008.08.076
  10. J.D. Shutler et al., "On a Large Sequence-Based Human Gait Database," Proc. Recent Advances in Soft Computing, Nottingham, UK, 2002.
  11. R. Poppe, "Vision-Based Human Motion Analysis: An Overview," Comput. Vision and Image Understanding, vol. 108, nos. 1-2, 2007, pp. 4-18. https://doi.org/10.1016/j.cviu.2006.10.016
  12. T. Ding, "A Robust Identification Approach to Gait Recognition," Proc. IEEE Conf. Comput. Vision Pattern Recog., Alaska, USA, 2008.
  13. R.D. Seely et al., "View Invariant Gait Recognition," Handbook of Remote Biometrics, Springer, 2009, pp. 61-81.
  14. A. Tsuji, Y. Makihara, and Y. Yagi, "Silhouette Transformation Based on Walking Speed for Gait Identification," Proc. IEEE Conf. Comput. Vision Pattern Recog., San Francisco, USA, 2010.
  15. K. Bashir, T. Xiang, and S. Gong, "Gait Recognition without Subject Cooperation," Pattern Recog. Lett., 2010.
  16. M. Gleicher, "Animation from Observation: Motion Capture and Motion Editing," Comput. Graphics, vol. 33, no. 4, 1999, pp. 51-55. https://doi.org/10.1145/345370.345409
  17. M.W. Whittle, Gait Analysis: An Introduction, Oxford: Butterworth Heinemann, 2002.
  18. R.F.M. Kleissen et al., "Electromyography in the Biomechanical Analysis of Human Movement and its Clinical Application," Gait and Posture, vol. 8, no. 2, 1988, pp.143-158.
  19. T.B. Moeslund and E. Granum, "A Survey of Computer Vision-Based Human Motion Capture," Comput. Vision and Image Understanding, vol. 81, no. 3, 2001, pp.231-268. https://doi.org/10.1006/cviu.2000.0897
  20. J.K. Aggarwal and Q. Cai, "Human Motion Analysis: A Review," Comput. Vision and Image Understanding, vol. 73, no. 3, 1999, pp.428-440. https://doi.org/10.1006/cviu.1998.0744
  21. W.T. Dempster and G.R.L. Gaughran, "Properties of Body Segments Based on Size and Weight," American J. Anatomy, vol. 120, 1967, pp. 33-54. https://doi.org/10.1002/aja.1001200104
  22. R. Drillis and R. Contini, "Body Segment Parameters," Technical Report 1163-03, New York University, New York, 1966.

Cited by

  1. Human Gait Feature Extraction Including a Kinematic Analysis toward Robotic Power Assistance vol.9, pp.3, 2011, https://doi.org/10.5772/50723
  2. Model-Based Human Gait Recognition Via Deterministic Learning vol.6, pp.2, 2011, https://doi.org/10.1007/s12559-013-9221-4
  3. Human Skeleton Model Based Dynamic Features for Walking Speed Invariant Gait Recognition vol.2014, pp.None, 2011, https://doi.org/10.1155/2014/484320
  4. Development of Vision Based Multiview Gait Recognition System with MMUGait Database vol.2014, pp.None, 2011, https://doi.org/10.1155/2014/376569
  5. Dynamic Distance-Based Shape Features for Gait Recognition vol.50, pp.3, 2014, https://doi.org/10.1007/s10851-014-0501-8
  6. A 2D Markerless Gait Analysis Methodology: Validation on Healthy Subjects vol.2015, pp.None, 2011, https://doi.org/10.1155/2015/186780
  7. Automated extraction and validation of children’s gait parameters with the Kinect vol.14, pp.None, 2015, https://doi.org/10.1186/s12938-015-0102-9
  8. Temporal Transfer of Locomotion Style vol.37, pp.2, 2015, https://doi.org/10.4218/etrij.15.0114.0021
  9. Classification of Normal and Pathological Gait in Young Children Based on Foot Pressure Data vol.15, pp.1, 2017, https://doi.org/10.1007/s12021-016-9313-x
  10. Gait Recognition Algorithm Based on Sparse Representation of Joint Multi-Feature Dictionary vol.7, pp.4, 2011, https://doi.org/10.12677/csa.2017.74048
  11. An Automated Classification of Pathological Gait Using Unobtrusive Sensing Technology vol.25, pp.12, 2017, https://doi.org/10.1109/tnsre.2017.2736939
  12. Gait Analysis Using Computer Vision Based on Cloud Platform and Mobile Device vol.2018, pp.None, 2011, https://doi.org/10.1155/2018/7381264
  13. Human Identification From Freestyle Walks Using Posture-Based Gait Feature vol.13, pp.1, 2011, https://doi.org/10.1109/tifs.2017.2738611
  14. Biometric recognition by gait: A survey of modalities and features vol.167, pp.None, 2011, https://doi.org/10.1016/j.cviu.2018.01.007
  15. Evaluation of gait recognition using dynamics of feature points and local shape features under clothing variation conditions vol.24, pp.1, 2019, https://doi.org/10.3408/jafst.745
  16. Developing a framework for promoting physical activity in a Boccia game scenario vol.7, pp.5, 2019, https://doi.org/10.1080/21681163.2018.1538816
  17. Reconstruction of occluded ROI in multi-person gait based on numerical methods vol.26, pp.3, 2011, https://doi.org/10.1007/s00530-019-00641-9
  18. Test-Retest, Inter-Rater and Intra-Rater Reliability for Spatiotemporal Gait Parameters Using SANE (an eaSy gAit aNalysis systEm) as Measuring Instrument vol.10, pp.17, 2011, https://doi.org/10.3390/app10175781
  19. Review of gait recognition approaches and their challenges on view changes vol.9, pp.6, 2011, https://doi.org/10.1049/iet-bmt.2020.0103
  20. A survey on spatio-temporal framework for kinematic gait analysis in RGB videos vol.79, pp.None, 2021, https://doi.org/10.1016/j.jvcir.2021.103218
  21. Development of a novel motion capture and gait analysis system for rat locomotion vol.35, pp.16, 2011, https://doi.org/10.1080/01691864.2021.1957013
  22. Vision-based approaches towards person identification using gait vol.42, pp.None, 2021, https://doi.org/10.1016/j.cosrev.2021.100432