• Smart Media Journal
• /
• v.1 no.2
• /
• pp.40-46
• /
• 2012

In this paper, we describe interactive contents which is used the result of the inputted interface recognizing vision-based body gesture. Because the content uses the imp which is the common culture as the subject in Asia, we can enjoy it with culture familiarity. And also since the player can use their own gesture to fight with the imp in the game, they are naturally absorbed in the game. And the users can choose the multiple endings of the contents in the end of the scenario. In the part of the gesture recognition, KINECT is used to obtain the three-dimensional coordinates of each joint of the limb to capture the static pose of the actions. The vision-based 3D human pose recognition technology is used to method for convey human gesture in HCI(Human-Computer Interaction). 2D pose model based recognition method recognizes simple 2D human pose in particular environment On the other hand, 3D pose model which describes 3D human body skeletal structure can recognize more complex 3D pose than 2D pose model in because it can use joint angle and shape information of body part Because gestures can be presented through sequential static poses, we recognize the gestures which are configured poses by using HMM In this paper, we describe the interactive content which is used as input interface by using gesture recognition result. So, we can control the contents using only user's gestures naturally. And we intended to improve the immersion and the interest by using the imp who is used real-time interaction with user.

• 재활복지
• /
• v.22 no.3
• /
• pp.209-224
• /
• 2018

The purpose of this study is to provide a basic data about the virtual reality rehabilitation therapy to the occupational therapist in the domestic clinical field by systematically analyzing the types and effects of the rehabilitation therapy using the virtual reality program. Research articles were retrieved from January 2007 to December 2017 using the Research Information Sharing Service (RISS), Google Scholar, and Pubmed database. The main search terms were 'Virtual Reality AND Rehabilitation' and 'Virtual reality AND Effect'. Finally, 10 foreign studies were selected as the subjects of this study. Selected studies were organized using PICO (Patient, Intervention, Comparison, Outcome) format. The results were as follows: The subjects were divided into 4 types, stroke, brain tumor, Parkinson 's disease, and kidney disease. The tools used for arbitration were three IREX (30 %), two X-box Kinect (20 %), two Nintendo Wii (20 %), one [Existing tool + VR] (10 %), one [Mobile application + VR] (10 %). As a result of the intervention, improvement of function was observed in all 10 studies from overseas, and physical function was 24 times (66 %), mental function 6 times (17 %), cognitive function 5 times (14 %), Activity of daily living 1 time (10 %). this study could be used as a basic resource to enhance the professionalism and quality of rehabilitation services and expand the scope by organizing virtual reality-based rehabilitation and its effects.

• Journal of the Korea Computer Graphics Society
• /
• v.28 no.2
• /
• pp.29-41
• /
• 2022

In this paper, we introduce a novel real-time, interactive animation system which uses real-time motion inputs from a low-cost motion-sensing device Kinect. Our system generates interaction motions between the user character and the counterpart character in real-time. While the motion of the user character is generated mimicking the user's input motion, the other character's motion is decided to react to the user avatar's motion. During a pre-processing step, our system analyzes the reference motion data and generates mapping model in advance. At run-time, our system first generates initial poses of two characters and then modifies them so that it could provide plausible interacting behavior. Our experimental results show plausible interacting animations in that the user character performs a modified motion of user input and the counterpart character properly reacts against the user character. The proposed method will be useful for developing real-time interactive animation systems which provide a better immersive experience for users.

• The Journal of Korean Academy of Sensory Integration
• /
• v.21 no.1
• /
• pp.34-46
• /
• 2023

Objective : The purpose of this study was to systematically analyze the methods by which virtual reality (VR)-based occupational therapy interventions are applied to disabled children and adolescents and to assess their effectiveness. Methods : The RISS, DBpia, KCI, Science Direct, and CINAHL MEDLINE databases were searched for relevant literature from January 2012 to August 2022. The main search terms used were "virtual reality," "work therapy," "youth," "virtual reality," "occupational therapy," "child," and "adolescent." A total of 16 documents were selected for analysis by the 4th stage of the PRISMA flowchart. Results : In the 16 selected studies, VR-based occupational therapy when used with children and adolescents with disabilities and was shown to have meaningful effects. Among the types of cerebral palsy covered in the studies, the most common was hemiplegia, and the evaluation tools used for measurement of the VR effect were daily activities, cognition, exercise technology, social-interaction technology, and visual-perception evaluation. Nintendo wii and Microsoft Kinect produced the VR tools most commonly used to improve motor skills and daily life. Conclusion : The results of this study indicate that VR interventions can be used effectively in clinical practice. In the future, they may assist in the diagnosis of disabled children and adolescents, in helping to select VR tools that are suitable for the purposes of intervention, and in the presentation of specific methods.

• KIPS Transactions on Software and Data Engineering
• /
• v.12 no.7
• /
• pp.315-324
• /
• 2023

A simple and accurate whole body rehabilitation interaction technology using immersive digital content is needed for elderly patients with steadily increasing age-related diseases. In this study, we introduce whole-body interaction technology using HoloLens and Kinect for this purpose. To achieve this, we propose three coordinate transformation methods: mesh feature point-based transformation, AR marker-based transformation, and body recognition-based transformation. The mesh feature point-based transformation aligns the coordinate system by designating three feature points on the spatial mesh and using a transform matrix. This method requires manual work and has lower usability, but has relatively high accuracy of 8.5mm. The AR marker-based method uses AR and QR markers recognized by HoloLens and Kinect simultaneously to achieve a compliant accuracy of 11.2mm. The body recognition-based transformation aligns the coordinate system by using the position of the head or HMD recognized by both devices and the position of both hands or controllers. This method has lower accuracy, but does not require additional tools or manual work, making it more user-friendly. Additionally, we reduced the error by more than 10% using RANSAC as a post-processing technique. These three methods can be selectively applied depending on the usability and accuracy required for the content. In this study, we validated this technology by applying it to the "Thunder Punch" and rehabilitation therapy content.

• Korean Journal of Computational Design and Engineering
• /
• v.18 no.4
• /
• pp.290-298
• /
• 2013

A walking navigation system (usually known as a locomotion interface) is an interactive platform which gives simulated walking sensation to users using sensed bipedal motion signals. This enables us to perform navigation tasks using only bipedal movement. Especially, it is useful for the certain VR task which emphasizes on physical human movement, or accompanies understanding of the size and complexity of building structures. In this work, we described system components of VR walking system and investigated several types of walking platform by literature survey. We adopted a MS Kinect depth sensor for the motion recognition and a treadmill which includes directional turning mechanism for the walking platform. Through the integration of these components with a VR navigation scenario, we developed a simple VR walking navigation system. Finally several technical issues were found during development process, and further research directions were suggested for the system improvement.

• Journal of Korea Game Society
• /
• v.17 no.5
• /
• pp.133-142
• /
• 2017

Recently, screen climbing contents such as sports climbing learning program and screen climbing games. Especially, there are many researches on screen climbing games. In this paper, we propose the skeleton correction method based on the body area of a climber to improve the posture recognition accuracy. The correction method consists of the modified skeletal frame normalization with abnormal skeleton joint filtering, the classification of body area into joint parts, and the final skeleton joint correction. The skeletal information obtained by the proposed method can be used to compare the climber's posture and the ideal climbing posture.

• ETRI Journal
• /
• v.40 no.4
• /
• pp.511-521
• /
• 2018

The ability to realize human-motion imitation using robots is closely related to developments in the field of artificial intelligence. However, it is not easy to imitate human motions entirely owing to the physical differences between the human body and robots. In this paper, we propose a work chain-based inverse kinematics to enable a robot to imitate the human motion of upper limbs in real time. Two work chains are built on each arm to ensure that there is motion similarity, such as the end effector trajectory and the joint-angle configuration. In addition, a two-phase filter is used to remove the interference and noise, together with a self-collision avoidance scheme to maintain the stability of the robot during the imitation. Experimental results verify the effectiveness of our solution on the humanoid robot Nao-H25 in terms of accuracy and real-time performance.

• Journal of Korea Multimedia Society
• /
• v.19 no.12
• /
• pp.1927-1935
• /
• 2016

This paper propose a framework for human body parts in RGB-D image. We conduct tasks of obtaining person area, finding candidate areas and local detection in order to detect hand, foot and head which have features of long accumulative geodesic distance. A person area is obtained with background subtraction and noise removal by using depth image which is robust to illumination change. Finding candidate areas performs construction of graph model which allows us to measure accumulative geodesic distance for the candidates. Instead of raw depth map, our approach constructs graph model with segmented regions by quadtree structure to improve searching time for the candidates. Local detection uses HOG based SVM for each parts, and head is detected for the first time. To minimize false detections for hand and foot parts, the candidates are classified with upper or lower body using the head position and properties of geodesic distance. Then, detect hand and foot with the local detectors. We evaluate our algorithm with datasets collected Kinect v2 sensor, and our approach shows good performance for head, hand and foot detection.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2017.04a
• /
• pp.1077-1078
• /
• 2017

In this study, we implement a natural user interface/experience framework using multi-sensors: Microsoft Kinect, Leap Motion, and Myo Armband. The framework is designed for customers to use in various types of interactive applications. We integrate the functions of three sensors into an application and provide an interface for customers, who can use it to interact with a computer easily. The framework can track body information in real-time, and accurately recognize the motion of different body parts.