• 제목/요약/키워드: Hand skeleton

검색결과 42건 처리시간 0.023초

HSFE Network and Fusion Model based Dynamic Hand Gesture Recognition

  • Tai, Do Nhu;Na, In Seop;Kim, Soo Hyung
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제14권9호
    • /
    • pp.3924-3940
    • /
    • 2020
  • Dynamic hand gesture recognition(d-HGR) plays an important role in human-computer interaction(HCI) system. With the growth of hand-pose estimation as well as 3D depth sensors, depth, and the hand-skeleton dataset is proposed to bring much research in depth and 3D hand skeleton approaches. However, it is still a challenging problem due to the low resolution, higher complexity, and self-occlusion. In this paper, we propose a hand-shape feature extraction(HSFE) network to produce robust hand-shapes. We build a hand-shape model, and hand-skeleton based on LSTM to exploit the temporal information from hand-shape and motion changes. Fusion between two models brings the best accuracy in dynamic hand gesture (DHG) dataset.

손동작 인지에 의한 원격 영상 제어 (Remote Image Control by Hand Motion Detection)

  • 임정근;한경호
    • 전기전자학회논문지
    • /
    • 제16권4호
    • /
    • pp.369-374
    • /
    • 2012
  • 본 논문에서는 손동작을 영상 입력 정보로 하여 기기의 기능을 제어하는 UX를 구현하였다 이를 위하여 Microsoft 사의 Kinect 센서를 이용하여 초당 30 프레임의 사용자의 3차원 depth map을 얻고 여기서 skeleton 이미지를 추출하여 손목 등의 관절의 위치에 대한 좌표 값을 얻는다. 전 후 프레임의 손의 위치가 변화하는 방향과 병화량으로부터 손 동작의 의미를 추출하고 다양한 손동작을 이용하여 스마트TV 등의 원격의 영상을 제어하는 명령어 입력으로 사용하는 UX를 제시하고 실험을 통하여 구현하였다.

W-Cu 계에서 W 분말골격의 in-situ 구조 변화와 Cu의 용침 kinetics (In-situ Structure Modification of W powder Skeleton and related Cu Infiltration Kinetics in W-Cu)

  • 이재성
    • 한국분말재료학회지
    • /
    • 제6권1호
    • /
    • pp.36-41
    • /
    • 1999
  • The present work has attempted to investigate the dependence of Cu infiltration kinetics on in-situ structure modification of W powder skeleton in W-Cu system. In-situ structure modification of W skeleton by addition of 0.3wt%Ni-P eutectic alloy was designed to proceed during heat-up of the W compact for Cu infiltration process. It was found that the Ni-P added W skeleton underwent remarkable stucture change only during heating-up. its structure was composed of large necks of W particles above 0.5 in the ratio of neck to particle size and smooth pore channels. The infiltration experiment showed that the infiltration kinetics for the W-Ni-P followed well the linear relationship of h vs. $t^{1/2}$ the rate constant K of which was in good agreement with the theoretical value. On the other hand, in case of the pure W skeleton a lower K value by 20% than the theoretical one was obatined. Such discrepancy is discussed in terms of skeleton structure induced infiltration mechanics.

  • PDF

경량 의수용 SMA 구동식 생체모방 손가락 모듈 (SMA-driven Biomimetic Finger Module for Lightweight Hand Prosthesis)

  • 정성윤;문인혁
    • 제어로봇시스템학회논문지
    • /
    • 제18권2호
    • /
    • pp.69-75
    • /
    • 2012
  • This paper proposes a biomimetic finger module to be used in a lightweight hand prosthesis. The finger module consists of finger skeleton and an actuator module driven by SMA (Shape Memory Alloy). The prototype finger module can perform flexion and extension motions; finger flexion is driven by a contraction force of SMA, but it is extended by an elastic force of an extension spring inserted into the finger skeleton. The finger motions are controlled by feedback of electric resistance of SMA because the finger module has no sensors to measure length and angle. Total weight of a prototype finger module is 30g. In experiments the finger motions and finger grip force are tested and compared with simulation results when a constant contraction force of SMA is given. The experimental results show that the proposed SMA-driven finger module is feasible to the lightweight hand prosthesis.

비전을 이용한 비접촉 스크린 입력장치 (Input Device of Non-Touch Screen Using Vision)

  • 서효동;주영훈
    • 전기학회논문지
    • /
    • 제60권10호
    • /
    • pp.1946-1950
    • /
    • 2011
  • This paper deals with an input device without the touch. The existing touch screens have some problems such as the week durability by frequent contact and the high cost by complex hardware configuration. In this paper, a non-touch input device is proposed to overcome these problems. The proposed method uses a skin color generated by the HCbCr color model and a hand region obtained by the labeling technique. In Addition, the skeleton model is employed to improve the recognition performance of the hand motion. Finally, the experiment results show the applicability of the proposed method.

소아의 수부골에 전이된 신장의 투명세포육종 -1례 보고- (Metastatic Clear Cell Sarcoma of the Kidney in a Child's Hand Bone - A Case Report -)

  • 심종섭;김지형;서연림
    • 대한골관절종양학회지
    • /
    • 제4권2호
    • /
    • pp.94-98
    • /
    • 1998
  • Clear cell sarcoma of the kidney (CCSK) is a rare malignant tumor of the renal origin in childhood, distinguished from Wilms tumor by its pathologic and clinical features. Bone metastasis is one of the characteristic clinical features. The common site of metastasis of the clear cell Sarcoma of the kidney is axial skeleton including skull, spines, ribs and femur. A cases of clear cell Sarcoma of the kidney presented to us, which solely metastasized to the hand bones without metastasizing to any other tissues including axial skeleton. We report this case with review of literatures.

  • PDF

대칭형 자유동작에 의한 3D 아바타 실시간 제어 알고리즘 (An algorithm for real-time control of a 3D avatar by symmetry-formed motions)

  • 장희동
    • 한국게임학회 논문지
    • /
    • 제3권2호
    • /
    • pp.24-29
    • /
    • 2003
  • The market of digital avatar with internet and digital technology is increasing rapidly. The users want to express any free-formed motion of their avatars in the cyber space. The user s motion capturing method as the avatar's motion can express any free-formed motion of the avatar in real-time but the methods are expensive and inconvenient. In this paper, we proposed a new method of expressing any free-formed motion of the avatar in real-time. The proposed method is an algorithm for real-time control of a 3D avatar in symmetry-formed free motion. Specially, the algorithm aims at the motion control of a 3D avatar for online dancing games. The proposed algorithm uses the skeleton character model and controls any one of two hands of the character model by a joystick with two sticks. In the symmetry-formed motion, the position and orientation of one hand can determine the position and orientation of the other hand. And the position and orientation of a hand as an end-effector can determine the pose of the arm by Inverse Kinematics. So the algorithm can control the symmetry-formed free motions of two arms by one joystick with two sticks. In the dance game, the algorithm controls the arm motion by the joystick and the other motion by the motion captured DB.

  • PDF

An Improved Approach for 3D Hand Pose Estimation Based on a Single Depth Image and Haar Random Forest

  • Kim, Wonggi;Chun, Junchul
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제9권8호
    • /
    • pp.3136-3150
    • /
    • 2015
  • A vision-based 3D tracking of articulated human hand is one of the major issues in the applications of human computer interactions and understanding the control of robot hand. This paper presents an improved approach for tracking and recovering the 3D position and orientation of a human hand using the Kinect sensor. The basic idea of the proposed method is to solve an optimization problem that minimizes the discrepancy in 3D shape between an actual hand observed by Kinect and a hypothesized 3D hand model. Since each of the 3D hand pose has 23 degrees of freedom, the hand articulation tracking needs computational excessive burden in minimizing the 3D shape discrepancy between an observed hand and a 3D hand model. For this, we first created a 3D hand model which represents the hand with 17 different parts. Secondly, Random Forest classifier was trained on the synthetic depth images generated by animating the developed 3D hand model, which was then used for Haar-like feature-based classification rather than performing per-pixel classification. Classification results were used for estimating the joint positions for the hand skeleton. Through the experiment, we were able to prove that the proposed method showed improvement rates in hand part recognition and a performance of 20-30 fps. The results confirmed its practical use in classifying hand area and successfully tracked and recovered the 3D hand pose in a real time fashion.

키넥트를 사용한 NUI 설계 및 구현 (A Design and Implementation of Natural User Interface System Using Kinect)

  • 이새봄;정일홍
    • 디지털콘텐츠학회 논문지
    • /
    • 제15권4호
    • /
    • pp.473-480
    • /
    • 2014
  • 오늘날 컴퓨터의 사용이 대중화 되면서 키보드나 마우스와 같은 기존의 사용자 인터페이스에 비해 보다 편리하고 자연스러운 인터페이스에 대한 연구가 활발히 진행되면서, 최근 마이크로소프트의 동작 인식 모듈인 키넥트에 대한 관심이 높아지고 있다. 키넥트는 내장된 센서를 통해 신체의 주요 관절의 움직임 및 깊이 정보를 인식할 수 있으며 내장 마이크를 통해 간단한 음성인식도 가능하다. 본 논문에서는 OpenCV 라이브러리를 키넥트에 접목하여, 키넥트의 깊이 데이터, skeleton tracking, labeling 알고리즘으로 손 영역 추출 및 움직임의 정보를 인식하여 가상 마우스와 가상 키보드를 구현하고, 음성인식을 통해 기존 입력 장치의 기능을 구현하는 것을 목표로 한다.

수지 운동을 제한하는 단독 골연골종 - 1예 보고 - (Unusual Presentation of Solitary Osteochondroma of Hand)

  • 최남홍;안형국
    • 대한골관절종양학회지
    • /
    • 제2권1호
    • /
    • pp.116-119
    • /
    • 1996
  • The solitary osteochondroma is a hamartoma of the skeleton which derives from an aberrant subperiosteal germ of the fertile cartilage. Osteochondromas, which are uncommon in the hand can occur at the distal end of the proximal and middle phalanx away from the epiphyseal plate region. We experienced a rare case of solitary osteochondroma arising from distal end of fifth proximal phalanx of hand, and limiting the active motion of proximal interphalangeal joint. The patient was treated by marginal excision and tumor showed characteristic microscopic findings of osteochondroma.

  • PDF