• Title/Summary/Keyword: kinect

Search Result 409, Processing Time 0.03 seconds

Study on Gesture and Voice-based Interaction in Perspective of a Presentation Support Tool

  • Ha, Sang-Ho;Park, So-Young;Hong, Hye-Soo;Kim, Nam-Hun
    • Journal of the Ergonomics Society of Korea
    • /
    • v.31 no.4
    • /
    • pp.593-599
    • /
    • 2012
  • Objective: This study aims to implement a non-contact gesture-based interface for presentation purposes and to analyze the effect of the proposed interface as information transfer assisted device. Background: Recently, research on control device using gesture recognition or speech recognition is being conducted with rapid technological growth in UI/UX area and appearance of smart service products which requires a new human-machine interface. However, few quantitative researches on practical effects of the new interface type have been done relatively, while activities on system implementation are very popular. Method: The system presented in this study is implemented with KINECT$^{(R)}$ sensor offered by Microsoft Corporation. To investigate whether the proposed system is effective as a presentation support tool or not, we conduct experiments by giving several lectures to 40 participants in both a traditional lecture room(keyboard-based presentation control) and a non-contact gesture-based lecture room(KINECT-based presentation control), evaluating their interests and immersion based on contents of the lecture and lecturing methods, and analyzing their understanding about contents of the lecture. Result: We check that whether the gesture-based presentation system can play effective role as presentation supporting tools or not depending on the level of difficulty of contents using ANOVA. Conclusion: We check that a non-contact gesture-based interface is a meaningful tool as a sportive device when delivering easy and simple information. However, the effect can vary with the contents and the level of difficulty of information provided. Application: The results presented in this paper might help to design a new human-machine(computer) interface for communication support tools.

Implementation of Paper Keyboard Piano with a Kinect (키넥트를 이용한 종이건반 피아노 구현 연구)

  • Lee, Jung-Chul;Kim, Min-Seong
    • Journal of the Korea Society of Computer and Information
    • /
    • v.17 no.12
    • /
    • pp.219-228
    • /
    • 2012
  • In this paper, we propose a paper keyboard piano implementation using the finger movement detection with the 3D image data from a kinect. Keyboard pattern and keyboard depth information are extracted from the color image and depth image to detect the touch event on the paper keyboard and to identify the touched key. Hand region detection error is unavoidable when using the simple comparison method between input depth image and background depth image, and this error is critical in key touch detection. Skin color is used to minimize the error. And finger tips are detected using contour detection with area limit and convex hull. Finally decision of key touch is carried out with the keyboard pattern information at the finger tip position. The experimental results showed that the proposed method can detect key touch with high accuracy. Paper keyboard piano can be utilized for the easy and convenient interface for the beginner to learn playing piano with the PC-based learning software.

On-line Signature Recognition Using Statistical Feature Based Artificial Neural Network (통계적 특징 기반 인공신경망을 이용한 온라인 서명인식)

  • Park, Seung-Je;Hwang, Seung-Jun;Na, Jong-Pil;Baek, Joong-Hwan
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.19 no.1
    • /
    • pp.106-112
    • /
    • 2015
  • In this paper, we propose an on-line signature recognition algorithm using fingertip point in the air from the depth image acquired by Kinect. We use ten statistical features for each X, Y, Z axis to react to changes in Shifting and Scaling of the signature trajectories in three-dimensional space. Artificial Neural Network is a machine learning algorithm used as a tool to solve the complex classification problem in pattern recognition. We implement the proposed algorithm to actual on-line signature recognition system. In experiment, we verify the proposed method is successful to classify 4 different on-line signatures.

Development of Kinect-Based Game model for Strengthening Muscle of The Gerontologic Lower Body (노인 하체 근력 강화를 위한 키넥트 센서 기반 게임 모델 개발)

  • Kang, Bo-yun;Kim, Yoon-Jung;Kim, Hyun-Kyung;Lee, Won-Hee;Park, Jung-Kyu;Park, Su e
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2017.10a
    • /
    • pp.185-188
    • /
    • 2017
  • Health promotion is essential for overcoming the low health longevity of senior citizens preparing for aging population. Therefore, the lower body strengthening exercise to prevent falls is crucial to prevent a fall in the number of deaths of senior citizens. In this game model, the elderly are aiming at home training contents that can be found to feel that the elderly are going out of walk and exercising in the natural environment. To achieve this, Kinect extracts a specific bone model provided by the Kinect Sensor to generate the feature vectors and recognizes the movements and motion of the user.

  • PDF

Implementation of Virtual Violin with a Kinect (키넥트를 이용한 가상 바이올린 구현)

  • Shin, Young-Kyu;Kang, Dong-Gil;Lee, Jung-Chul
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.15 no.3
    • /
    • pp.85-90
    • /
    • 2014
  • In this paper, we propose a virtual violin implementation using the detection of bowing and finger dropping position from the estimated finger tip and finger board information with the 3D image data from a Kinect. Violin finger board pattern and depth information are extracted from the color image and depth image to detect the touch event on the violin finger board and to identify the touched position. Final decision of activated musical alphabet is carried out with the finger drop position and bowing information. Our virtual violin uses PC MIDI to output synthesized violin sound. The experimental results showed that the proposed method can detect finger drop position and bowing detection with high accuracy. Virtual violin can be utilized for the easy and convenient interface for a beginner to learn playing violin with the PC-based learning software.

Comparative Evaluation of Exercise Effects of Motion-based Sports Game (체감형 스포츠 게임의 운동 효과 비교 평가)

  • Boo, Jae Hui;An, Ji Hyeon;Kim, Jeong Hyeon;Kim, Dong Keun;Park, Kyoung Shin
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.26 no.3
    • /
    • pp.403-411
    • /
    • 2022
  • A motion-based sports game uses a motion sensor or a camera to exercise based on body movements, and it is possible to obtain exercise effects such as improving physical strength while enjoying the game. In prior works, various studies such as usability evaluation has been conducted on motion-based sports games. However, there has been no discussion about how the exercise effect is exerted on users when experiencing motion-based sports games as individual or team play. This study compared the user's exercise effects by analyzing the user's ECG (Electrocardiogram) sensor and the Kinect sensor's skeletal information using Nintendo Switch game that is played individually and as a team. In this paper, the experimental design and method, the quantitative measurement results based on ECG and Kinect, and the results of the post-test subjective measurement are discussed.

Effects of Kinect-Based Mixed Reality Device on Physical Function and Quality of Life in Breast Cancer Survivors : A randomized controlled trial

  • Byung-Gul Lim;Xinxing Li;Yun-Ho Sung;Si-Woo LEE;Hyun-Jun Kim;Wook Song
    • Journal of The Korean Society of Integrative Medicine
    • /
    • v.11 no.2
    • /
    • pp.49-60
    • /
    • 2023
  • Purpose : We aimed to evaluate the impact of a exercise with kinect-based mixed reality device (KMR) on physical function, upper extremity disability, fatigue, and quality of life in breast cancer survivors. We hypothesized that this exercise program would improve physical function, physical activity, fatigue, and quality of life. Methods : Thirty-nine breast cancer survivors were randomized to either the KMR exercise group (KE) or the home stretch group (HS). The KE participated in 8 weeks of exercise, exercising 3 times per week, while the HS performed 8 weeks of stretching exercises, also 3 times per week. Before and after the intervention period, participants underwent assessments of physical function, including body composition, chester step test (CST), and hand grip strength (HGS). Additionally, participants completed questionnaires including the international physical activity questionnaire (IPAQ), disabilities of the arm, shoulder and hand (DASH) questionnaire, and functional assessment of cancer therapy-breast (FACT-B) questionnaire to measure their physical activity levels, upper extremity disability, and quality of life, respectively. Results : Overall, significant improvements were observed in several shoulder movements, body weight, and physical activity, with no significant interaction effects between groups and time. Furthermore, there was a significant group by time interaction for body weight, left flexion, right flexion, right abduction, and left adduction, as well as for upper extremity disability (K-DASH) and quality of life (FACT-B). Conclusion : In conclusion, the KMR exercise program was found to be effective at improving physical function, upper extremity disability, quality of life, and overall well-being in breast cancer survivors. The significant improvements observed in multiple measures and the significant group by time interactions for various outcomes highlight the potential benefits of this KMR exercise program in promoting a better quality of life for breast cancer survivors.