DOI QR코드

DOI QR Code

HMD 환경에서 사용자 손의 자세 추정을 위한 MLP 기반 마커 분류

Marker Classification by Sensor Fusion for Hand Pose Tracking in HMD Environments using MLP

  • 록콩부 (HCI 및 로봇공학과, 과학기술연합대학원대학교) ;
  • 최은석 (HCI 및 로봇공학과, 과학기술연합대학원대학교) ;
  • 유범재 (HCI 및 로봇공학과, 과학기술연합대학원대학교)
  • Vu, Luc Cong (Dept. of HCI & Robotics Engineering, Univ. of Science and Technology(UST)) ;
  • Choi, Eun-Seok (Dept. of HCI & Robotics Engineering, Univ. of Science and Technology(UST)) ;
  • You, Bum-Jae (Dept. of HCI & Robotics Engineering, Univ. of Science and Technology(UST))
  • 발행 : 2018.10.31

초록

This paper describes a method to classify simple circular artificial markers on surfaces of a box on the back of hand to detect the pose of user's hand for VR/AR applications by using a Leap Motion camera and two IMU sensors. One IMU sensor is located in the box and the other IMU sensor is fixed with the camera. Multi-layer Perceptron (MLP) algorithm is adopted to classify artificial markers on each surface tracked by the camera using IMU sensor data. It is experimented successfully in real-time, 70Hz, under PC environments.

키워드