Journal of Institute of Control, Robotics and Systems (제어로봇시스템학회논문지)

Institute of Control, Robotics and Systems (제어로봇시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Marionette Control System using Gesture Mode Change

제스처 할당 모드를 이용한 마리오네트 조정 시스템

  • Cheon, Kyeong-Min (Department of Nanobiotronics, Hoseo University) ;
  • Kwak, Su Hui (Department of Robotic Engineering, Hoseo University) ;
  • Rew, Keun-Ho (Department of Robotic Engineering, Hoseo University)
  • 천경민 (호서대학교 나노바이오트로닉스학과) ;
  • 곽수희 (호서대학교 로봇자동화전공) ;
  • 류근호 (호서대학교 로봇자동화전공)
  • Received : 2014.09.30
  • Accepted : 2014.12.12
  • Published : 2015.02.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, a marionette control system using wrist and finger gestures through an IMU sensor is studied. The signals from the sensor device are conditioned and recognized, then the commands are sent to the 8 motors of the marionette via Bluetooth (5 motors control the motion of the marionette, and 3 motors control the location of the marionette). It is revealed that the degree of freedom of fingers are not independent from each other, therefore, some gestures are hardly made. Gesture mode changes for difficult postures of the fingers in cases of a lack of finger DOF are proposed. Therefore, the gesture mode change switches the assignment of gesture as required. Experimental results show that gesture mode change is successful for appropriate postures of a marionette.

Keywords

References

  1. S. C. Kim and Z. Y. Che, "A method for tennis swing recognition using accelerator sensors on a smartphone," Journal of Korea Game Society (in Korean), vol. 13, no. 2, pp. 29-38, Apr. 2013. https://doi.org/10.7583/JKGS.2013.13.2.29
  2. Y. C. Lee and C. W. Lee, "Android platform based gesture recognition using smart phone sensor data," Smart Media Journal (in Korean), vol. 1, no. 4, pp. 18-26, Dec. 2012.
  3. S. H. Nam, J. H. Kim, S. K. Heo, and I. C. Kim, "Smartphone accelerometer-based gesture recognition and its robotic application," KIPS Transactions on Software and Data Engineering (in Korean), vol. 2, no. 6, pp. 395-402, Jun. 2013. https://doi.org/10.3745/KTSDE.2013.2.6.395
  4. M. S. Jang, Y. S. Cho, J. H. Kim, and J. C. Sohn, "Accelerometer-based gesture recognition for robot interface," Journal of Intelligence and Information Systems (in Korean), vol. 17, no. 1, pp. 53-69, Mar. 2011.
  5. H. Y. Kim and J. K. Min, "Implementation of a Motion Capture System using 3-axis Accelerometer," Journal of KIISE : Computing Practices and Letters (in Korean), vol. 17, no. 6, pp. 383-388, Jun 2011.
  6. K. H. Park, H. J. Lee, and Y. H. Kim, "Implementation of the hand-motion recognition based auxiliary input device using gyro sensor," Journal of Korea Navigation Institute (in Korean), vol. 13, no. 4, pp. 503-508, Aug. 2009.
  7. N. H. Kim, "Development of globe-type radio mouse using gyro sensor," Journal of the Korea Institute of Maritime Information & Communication Sciences (in Korean), vol. 13, no. 8, pp. 1721-1728, Aug. 2008.
  8. K. M. Cheon and K. H. Rew, "Recognition of 3d gesture through motion sensor," Journal of Industrial Technology Research (in Korean), vol. 33, no. 1, pp. 15-21, Jun. 2014.
  9. J. Rett and J. Dias, "Gesture recognition using a marionette model and dynamic bayesian networks (DBNs)," Proc. of ICIAR 2006, Portugal, vol. 4142, pp. 69-80, 2006.
  10. I. M. Chen, R. Tay, S. Xing, and S. H. Yeo, "Marionette: from traditional manipulation to robotic manipulation," Proc. of International Symposium on History of Machines and Mechanisms, Cassiano, Italy, pp. 119-133, 2004.
  11. T. Takuho, K. Nishii, K. Inoue, Y. Mae, and T. Arai, "Marionette system for operating and displaying robot whole-body motion-development of similar humanoid-type device," Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems, Sendai, Japan, vol. 1, pp. 509-514, Oct. 2004.
  12. K. D. Nguyen, I. M. Chen, S. H. Yeo, and B. L. Duh, "Motion control of a robotic puppet through a hybrid motion capture device," Proc. of IEEE Conference on Automation Science and Engineering, AZ, USA, pp. 753-758, Sep. 2007.
  13. P. Kingston and M. Egerstedt, "Time and output warping of control systems: comparing and imitating motions," Automatica, vol. 47, pp. 1580-1588, Feb. 2011. https://doi.org/10.1016/j.automatica.2011.03.004
  14. T. Takubo, K. Inoue, and T. Arai, "Wholebody teleoperation for humanoid robot by marionette system," Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing, China, pp. 4459-4465, Oct. 2006.
  15. J. M. Yoo, S. K. Ra, E. T. Kim, and C. H. Kim, "Humanoid robot control using marionette-type motion conversion," Pros. of the Korean Institute of Electrical Engineers (in Korean), pp. 1801-1802, Jul. 2008.
  16. K. M. Choi, Y. G. Na, S. B. Chae, and K. H. Jung, "A hand gesture-based remote control of robot," Journal of Korean Society Of Broadcast Engineers (in Korean), pp. 196-199, Nov. 2010.
  17. M. S. Chang, S. D. Kwak, and S. M. Kang, "Presentation control system using gesture recognition and sensor," Journal of Korean Institute of Intelligent Systems (in Korean), vol. 21, no. 4, pp. 481-486, Aug. 2011. https://doi.org/10.5391/JKIIS.2011.21.4.481
  18. C. K. Han and E. S. Jeong, "A Survey on Human Figure Representation in Computer Graphics," Journal of the Ergonomics Society Of Korea (in Korean), vol. 12, no. 1, pp. 57-73, Jun. 1993.
  19. Y. K. Kim, J. H. Park, H. K. Kwak, S. H. Park, C. W. Lee, and J. M. Lee, "Performance improvement of a pedestrian dead reckoning system using a low cost IMU," Journal of Institue of Control, Robotics and Systems (in Korean), vol. 19, no. 6, pp. 569-575, Jun. 2013. https://doi.org/10.5302/J.ICROS.2013.12.1767
  20. S. Y. Cho, "BiaXial accelerometer-based magnetic compass module calibration and analysis of azimuth computational errors caused by accelerometer errors," Journal of Institue of Control, Robotics and Systems (in Korean), vol. 20, no. 2, pp. 149-156, Feb. 2014. https://doi.org/10.5302/J.ICROS.2014.13.9008