• Title/Summary/Keyword: Hand skeleton

Search Result 42, Processing Time 0.035 seconds

HSFE Network and Fusion Model based Dynamic Hand Gesture Recognition

  • Tai, Do Nhu;Na, In Seop;Kim, Soo Hyung
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.9
    • /
    • pp.3924-3940
    • /
    • 2020
  • Dynamic hand gesture recognition(d-HGR) plays an important role in human-computer interaction(HCI) system. With the growth of hand-pose estimation as well as 3D depth sensors, depth, and the hand-skeleton dataset is proposed to bring much research in depth and 3D hand skeleton approaches. However, it is still a challenging problem due to the low resolution, higher complexity, and self-occlusion. In this paper, we propose a hand-shape feature extraction(HSFE) network to produce robust hand-shapes. We build a hand-shape model, and hand-skeleton based on LSTM to exploit the temporal information from hand-shape and motion changes. Fusion between two models brings the best accuracy in dynamic hand gesture (DHG) dataset.

Remote Image Control by Hand Motion Detection (손동작 인지에 의한 원격 영상 제어)

  • Lim, Jung-Geun;Han, Kyongho
    • Journal of IKEEE
    • /
    • v.16 no.4
    • /
    • pp.369-374
    • /
    • 2012
  • This paper handles the UX implementation for system control using the visual input information of hand motion. Kinect sensor from Microsoft is used to acquire the user's skeleton image from the 3-D depth map at a rate of 30 frames per sec. and eventually knows the x-y coordinates of hand joints. The x-y coordinate value changes of hands between the present frame and next frame shows the direction of changes and rotation of changes and the various hand motion is used as a UX input command for remote image control on smart TV, etc. Through the experiments, we showed the implementation of the proposed idea.

In-situ Structure Modification of W powder Skeleton and related Cu Infiltration Kinetics in W-Cu (W-Cu 계에서 W 분말골격의 in-situ 구조 변화와 Cu의 용침 kinetics)

  • 이재성
    • Journal of Powder Materials
    • /
    • v.6 no.1
    • /
    • pp.36-41
    • /
    • 1999
  • The present work has attempted to investigate the dependence of Cu infiltration kinetics on in-situ structure modification of W powder skeleton in W-Cu system. In-situ structure modification of W skeleton by addition of 0.3wt%Ni-P eutectic alloy was designed to proceed during heat-up of the W compact for Cu infiltration process. It was found that the Ni-P added W skeleton underwent remarkable stucture change only during heating-up. its structure was composed of large necks of W particles above 0.5 in the ratio of neck to particle size and smooth pore channels. The infiltration experiment showed that the infiltration kinetics for the W-Ni-P followed well the linear relationship of h vs. $t^{1/2}$ the rate constant K of which was in good agreement with the theoretical value. On the other hand, in case of the pure W skeleton a lower K value by 20% than the theoretical one was obatined. Such discrepancy is discussed in terms of skeleton structure induced infiltration mechanics.

  • PDF

SMA-driven Biomimetic Finger Module for Lightweight Hand Prosthesis (경량 의수용 SMA 구동식 생체모방 손가락 모듈)

  • Jung, Sung-Yoon;Moon, In-Hyuk
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.18 no.2
    • /
    • pp.69-75
    • /
    • 2012
  • This paper proposes a biomimetic finger module to be used in a lightweight hand prosthesis. The finger module consists of finger skeleton and an actuator module driven by SMA (Shape Memory Alloy). The prototype finger module can perform flexion and extension motions; finger flexion is driven by a contraction force of SMA, but it is extended by an elastic force of an extension spring inserted into the finger skeleton. The finger motions are controlled by feedback of electric resistance of SMA because the finger module has no sensors to measure length and angle. Total weight of a prototype finger module is 30g. In experiments the finger motions and finger grip force are tested and compared with simulation results when a constant contraction force of SMA is given. The experimental results show that the proposed SMA-driven finger module is feasible to the lightweight hand prosthesis.

Input Device of Non-Touch Screen Using Vision (비전을 이용한 비접촉 스크린 입력장치)

  • Seo, Hyo-Dong;Joo, Young-Hoon
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.60 no.10
    • /
    • pp.1946-1950
    • /
    • 2011
  • This paper deals with an input device without the touch. The existing touch screens have some problems such as the week durability by frequent contact and the high cost by complex hardware configuration. In this paper, a non-touch input device is proposed to overcome these problems. The proposed method uses a skin color generated by the HCbCr color model and a hand region obtained by the labeling technique. In Addition, the skeleton model is employed to improve the recognition performance of the hand motion. Finally, the experiment results show the applicability of the proposed method.

Metastatic Clear Cell Sarcoma of the Kidney in a Child's Hand Bone - A Case Report - (소아의 수부골에 전이된 신장의 투명세포육종 -1례 보고-)

  • Shim, Jong-Sup;Kim, Jee-Hyoung;Suh, Yeon-Lim
    • The Journal of the Korean bone and joint tumor society
    • /
    • v.4 no.2
    • /
    • pp.94-98
    • /
    • 1998
  • Clear cell sarcoma of the kidney (CCSK) is a rare malignant tumor of the renal origin in childhood, distinguished from Wilms tumor by its pathologic and clinical features. Bone metastasis is one of the characteristic clinical features. The common site of metastasis of the clear cell Sarcoma of the kidney is axial skeleton including skull, spines, ribs and femur. A cases of clear cell Sarcoma of the kidney presented to us, which solely metastasized to the hand bones without metastasizing to any other tissues including axial skeleton. We report this case with review of literatures.

  • PDF

An algorithm for real-time control of a 3D avatar by symmetry-formed motions (대칭형 자유동작에 의한 3D 아바타 실시간 제어 알고리즘)

  • Chang, Hee-Dong
    • Journal of Korea Game Society
    • /
    • v.3 no.2
    • /
    • pp.24-29
    • /
    • 2003
  • The market of digital avatar with internet and digital technology is increasing rapidly. The users want to express any free-formed motion of their avatars in the cyber space. The user s motion capturing method as the avatar's motion can express any free-formed motion of the avatar in real-time but the methods are expensive and inconvenient. In this paper, we proposed a new method of expressing any free-formed motion of the avatar in real-time. The proposed method is an algorithm for real-time control of a 3D avatar in symmetry-formed free motion. Specially, the algorithm aims at the motion control of a 3D avatar for online dancing games. The proposed algorithm uses the skeleton character model and controls any one of two hands of the character model by a joystick with two sticks. In the symmetry-formed motion, the position and orientation of one hand can determine the position and orientation of the other hand. And the position and orientation of a hand as an end-effector can determine the pose of the arm by Inverse Kinematics. So the algorithm can control the symmetry-formed free motions of two arms by one joystick with two sticks. In the dance game, the algorithm controls the arm motion by the joystick and the other motion by the motion captured DB.

  • PDF

An Improved Approach for 3D Hand Pose Estimation Based on a Single Depth Image and Haar Random Forest

  • Kim, Wonggi;Chun, Junchul
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.9 no.8
    • /
    • pp.3136-3150
    • /
    • 2015
  • A vision-based 3D tracking of articulated human hand is one of the major issues in the applications of human computer interactions and understanding the control of robot hand. This paper presents an improved approach for tracking and recovering the 3D position and orientation of a human hand using the Kinect sensor. The basic idea of the proposed method is to solve an optimization problem that minimizes the discrepancy in 3D shape between an actual hand observed by Kinect and a hypothesized 3D hand model. Since each of the 3D hand pose has 23 degrees of freedom, the hand articulation tracking needs computational excessive burden in minimizing the 3D shape discrepancy between an observed hand and a 3D hand model. For this, we first created a 3D hand model which represents the hand with 17 different parts. Secondly, Random Forest classifier was trained on the synthetic depth images generated by animating the developed 3D hand model, which was then used for Haar-like feature-based classification rather than performing per-pixel classification. Classification results were used for estimating the joint positions for the hand skeleton. Through the experiment, we were able to prove that the proposed method showed improvement rates in hand part recognition and a performance of 20-30 fps. The results confirmed its practical use in classifying hand area and successfully tracked and recovered the 3D hand pose in a real time fashion.

A Design and Implementation of Natural User Interface System Using Kinect (키넥트를 사용한 NUI 설계 및 구현)

  • Lee, Sae-Bom;Jung, Il-Hong
    • Journal of Digital Contents Society
    • /
    • v.15 no.4
    • /
    • pp.473-480
    • /
    • 2014
  • As the use of computer has been popularized these days, an active research is in progress to make much more convenient and natural interface compared to the existing user interfaces such as keyboard or mouse. For this reason, there is an increasing interest toward Microsoft's motion sensing module called Kinect, which can perform hand motions and speech recognition system in order to realize communication between people. Kinect uses its built-in sensor to recognize the main joint movements and depth of the body. It can also provide a simple speech recognition through the built-in microphone. In this paper, the goal is to use Kinect's depth value data, skeleton tracking and labeling algorithm to recognize information about the extraction and movement of hand, and replace the role of existing peripherals using a virtual mouse, a virtual keyboard, and a speech recognition.

Unusual Presentation of Solitary Osteochondroma of Hand (수지 운동을 제한하는 단독 골연골종 - 1예 보고 -)

  • Choi, Nam-Hong;Ahn, Hyoung-Kook
    • The Journal of the Korean bone and joint tumor society
    • /
    • v.2 no.1
    • /
    • pp.116-119
    • /
    • 1996
  • The solitary osteochondroma is a hamartoma of the skeleton which derives from an aberrant subperiosteal germ of the fertile cartilage. Osteochondromas, which are uncommon in the hand can occur at the distal end of the proximal and middle phalanx away from the epiphyseal plate region. We experienced a rare case of solitary osteochondroma arising from distal end of fifth proximal phalanx of hand, and limiting the active motion of proximal interphalangeal joint. The patient was treated by marginal excision and tumor showed characteristic microscopic findings of osteochondroma.

  • PDF