KIPS Transactions on Software and Data Engineering (정보처리학회논문지:소프트웨어 및 데이터공학)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Smartphone Accelerometer-Based Gesture Recognition and its Robotic Application

스마트폰 가속도 센서 기반의 제스처 인식과 로봇 응용

  • 남상하 (경기대학교 컴퓨터과학과) ;
  • 김주희 (경기대학교 컴퓨터과학과) ;
  • 허세경 (경기대학교 컴퓨터과학과) ;
  • 김인철 (경기대학교 컴퓨터과학과)
  • Received : 2013.02.18
  • Accepted : 2013.03.13
  • Published : 2013.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

We propose an accelerometer-based gesture recognition method for smartphone users. In our method, similarities between a new time series accelerometer data and each gesture exemplar are computed with DTW algorithm, and then the best matching gesture is determined based on k-NN algorithm. In order to investigate the performance of our method, we implemented a gesture recognition program working on an Android smartphone and a gesture-based teleoperating robot system. Through a set of user-mixed and user-independent experiments, we showed that the proposed method and implementation have high performance and scalability.

본 논문에서는 스마트폰 사용자를 위한 가속도 센서 기반의 제스처 인식 방법을 제안한다. 제안하는 제스처 인식 방법에서는 DTW 알고리즘을 적용하여 새로운 시계열 가속도 데이터와 각 제스처별 대표 훈련 데이터간의 유사도를 측정한 뒤, k-NN 알고리즘을 적용하여 제스처를 판별한다. 본 논문에서 제안하는 제스처 인식 방법의 성능을 분석해보기 위해, 안드로이드 스마트폰에서 동작하는 제스처 인식 프로그램과 이것을 활용한 제스처 기반 원격 제어 로봇 시스템을 구현하였다. 사용자-혼합 및 사용자-독립 실험들을 통해, 본 논문에서 제안한 제스처 인식방법과 구현 시스템이 높은 인식 성능과 확장성을 가진다는 것을 보였다.

Keywords

References

  1. J. Kim, S. Nam, S. Heo, I. Kim, "Design of an Activity Recognition System using Smartphone Accelerometer", KIPS Transaction on Software and Data Engineering, Vol.2, No.1, pp.1-6, 2013. https://doi.org/10.3745/KTSDE.2013.2.1.049
  2. J. Liu, L. Zhong, J. Wickramasuriya, V. Vasudevan, "uWave: Accelerometer-based Personalized Gesture Recognition and its Applications", Pervasive and Mobile Computing, Vol.5, pp.657-675, 2009. https://doi.org/10.1016/j.pmcj.2009.07.007
  3. S. Cho, E. Choi, W. Bang, J. Yang, "Two-stage Recognition of Raw Acceleration Signals for 3-D Gesture-Understanding Cell Phones", Proceedings of the 10th International Workshop on Frontiers in Handwriting Recognition, 2006.
  4. K. Oh, Y. Jeong, S. Kim, H. Choi. "Gesture Recognition Application with Parametric Hidden Markov Model for Activity-Based Personalized Service in APPiME", Proceedings of the First IEEE International Conference on Situation Awareness and Decision Support, 2011.
  5. A. Akl, C. Feng, S. Valaee, "A Novel Accelerometer-Based Gesture Recognition System", IEEE Transaction on Signal Processing, Vol.59, No.12, pp.6197-6205, 2011. https://doi.org/10.1109/TSP.2011.2165707
  6. G. Neizen, G. P. Hancke, "Evaluating and Optimizing Accelerometer-based Gesture Recognition Techniques for Mobile Devices", Proceedings of IEEE AFRICON-09, 2009.
  7. T. Marasovic, V. Papic, "Accelerometer-Based Gesture Classification Using Principal Component Analysis", Proceedings of the 19th IEEE International Conference on Software, Telecommunications and Computer Networks, 2011.
  8. P. Neto, J. N. Pires, A. P. Moreira, "Accelerometer-Based Control of an Industrial Robotic Arm", Proc. of the 18th IEEE International Symposium on Robot and Human Interactive Communication, 2009.
  9. A. Uribe, et al., "Mobile Robotic Teleoperation using Gesture-Based Human Interfaces", Proceedings of IEEE Latin American and Colombian Conference on Automatic Control and Industry Applications(LARC), 2011.
  10. K. Serafimov, et al., "Using Mobile-phone Accelerometer for Gestural Control of Soccer Robots", Proceedings of Mediterranean Conference on Embedded Computing(MECO), 2012.

Cited by

  1. Development of a Physical Training Management Module Using Smart Devices vol.25, pp.6, 2015, https://doi.org/10.5391/JKIIS.2015.25.6.571
  2. Feature-Strengthened Gesture Recognition Model Based on Dynamic Time Warping for Multi-Users vol.5, pp.10, 2016, https://doi.org/10.3745/KTSDE.2016.5.10.503
  3. Marionette Control System using Gesture Mode Change vol.21, pp.2, 2015, https://doi.org/10.5302/J.ICROS.2015.14.0105
  4. Feature-Strengthened Gesture Recognition Model based on Dynamic Time Warping vol.4, pp.3, 2015, https://doi.org/10.3745/KTSDE.2015.4.3.143