• The Journal of the Korea Contents Association
• /
• v.12 no.9
• /
• pp.40-47
• /
• 2012

Existing art, media art, accompanied by a new path of awareness and perception instrumentalized by the human body, creating a new way to watch the interaction is proposed. Western art way to create visual images of the point cloud that represented a form that is similar to the Pointage. This traditional painting techniques using digital technology means reconfiguration. In this paper, a new appreciation of fusion of aesthetic elements and digital technology, making the point cloud in the form of video. And this holographic film projection of the spectator, and gestures to interact with the video content is presented. A Process of making contents is intent planning, content creation, content production point cloud in the form of image, 3D gestures for interaction design process, go through the process of holographic film projection. Visual and experiential content of memory recall process takes place in the consciousness of the people expressed. Complete the process of memory recall, uncertain memories, memories materialized, recalled. Uncertain remember the vague shapes of the point cloud in the form of an image represented by the image. As embodied memories through the act of interaction to manipulate images recall is complete.

• Journal of Korea Game Society
• /
• v.15 no.2
• /
• pp.43-52
• /
• 2015

This Study suggests the user-friendly game playing method of rhythm dance game focusing on the natural interaction between music and user's movement. When the existing rhythm dance games have given the limitation to users, this study chose the game playing method using beat that is consist of basic element in dance music for minimizing the limitation. Beat feeling method automatically figures out each body position value extracted with Kinect that divided into three parts of shoulder, knee, and head. Accoring to this process, users can play the game to individual dance style, not fixed rules for game.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2014.11a
• /
• pp.81-83
• /
• 2014

본 논문은 HD 해상도의 고화질 방송카메라(회전과 줌이 가능한)와 '키넥트' 같은 범용 모션인식 카메라를 연동하여 방송용 모션기반 증강현실 어플리케이션을 구현하기 위해서, 연기자의 위치를 가상 월드 좌표로 자동 변환시키는 방법을 제안한다. 방송환경에서 키넥트와 같은 모션인식카메라(RGB-D 카메라)를 사용하기 위해서는 거리와 조명의 영향을 많이 받아 연기자와 가까운 천장이나 카메라 밑처럼 그 설치 위치가 제약되곤 한다. 이때, 연기자와 그래픽의 정확한 합성을 위해, 모션인식 카메라로부터의 연기자 추적 정보를 월드 좌표계로 변환해야 하며, 이것을 수작업으로 하기에는 변환의 정확도가 많이 떨어지고 시간도 많이 소요된다. 본 논문에서는 체크박스 패턴 기반의 스테레오 카메라보정 알고리즘을 사용하여 모션인식카메라와 방송용 카메라간의 상관관계(이동, 회전)를 찾고, 이 값과 월드 좌표계 상의 방송 카메라(하드웨어 센서에 의해서 추적됨)정보(이동, 회전)를 이용하여 임의 위치에 설치한 모션인식 카메라로부터 추적된 연기자 위치정보를 월드 좌표계 상의 위치 값으로 자동 변환시키는 방법을 제안한다.

• The Journal of the Korea Contents Association
• /
• v.16 no.3
• /
• pp.43-51
• /
• 2016

This paper presents the concept of "interactive teleprompter", which provides the user with interaction with oneself or other users for live television broadcasts or smart mirrors. In such interactive applications, eye contacts between the user and the regenerated image or between the user and other persons are important in handling psychological processes or non-verbal communications. Unfortunately, it is not straightforward to address the eye contact issues with conventional combination of normal display and video camera. To address this problem, we propose an "interactive" teleprompter enhanced from conventional teleprompter devices. Our interactive teleprompter can recognize the user's gestures by applying infra-red (IR) depth sensor. This paper also presents test results for a beam splitter which plays a critical role for teleprompter and is designed to handle both visual light for RGB camera and IR for Depth sensor effectively.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2022.05a
• /
• pp.394-395
• /
• 2022

Exergames are playing an important role in healthcare/rehabilitation. It has also been used to improve motivation among patients with reduced cognition. The purpose of this pilot study was to evaluate the feasibility of using augmented reality (AR) with game-based cognitive-motor training programs for executive function, restricted and repetitive behaviors (RRBs) in children with autism spectrum disorder. Sixteen children aged 6 -16 years were randomly allocated to the experimental group and control group. Outcome measures were performed before and after the intervention and included executive function, restricted and repetitive behavior. A satisfactory survey was conducted post-intervention. A statistically significant improvement was observed in working memory and cognitive flexibility in the experimental group (P<0.05). However, despite no statistical improvements in cognitive inhibition and four subscales of RRBs, promising changes were observed in all the subscales of the executive function and the behavioral outcomes. Parents appreciated the program and children enjoyed the interaction with the AR game-based training. The findings of this preliminary feasibility study showed that AR using Kinect v2 motion with a cognitive-motor game content can be used for children with autism. However, there is a need for conducting a large-scale study to evaluate his effectiveness on executive function and restricted and repetitive behaviors.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.24 no.7
• /
• pp.866-872
• /
• 2020

Indoor location-based services provide a service based on the distance between an object and a person. Recently, indoor location-based services are often implemented using inexpensive depth sensors such as Kinect. The depth sensor provides a function to measure the position of a person, but the position of an object must be acquired manually using a tool. To acquire a 3D position of an object, it requires 3D interaction, which is difficult to a general user. GUI(Graphical User Interface) is relatively easy to a general user but it is hard to gather a 3D position. This study proposes the Interactive LOcation Context Authoring Toolkit(ILOCAT), which enables a general user to easily acquire a 3D position of an object in real space using GUI. This paper describes the interaction design and implementation of ILOCAT.

• Journal of the Korea Society of Computer and Information
• /
• v.27 no.3
• /
• pp.45-52
• /
• 2022

A tangible sports game is an exercise game that uses sensors or cameras to track the user's body movements and to feel a sense of reality. Recently, VR indoor sports room systems installed to utilize tangible sports game for physical activity in schools. However, these systems primarily use screen-touch user interaction. In this research, we developed a V-Catch Vision system that uses AI image recognition technology to enable tracking of user movements in three-dimensional space rather than two-dimensional wall touch interaction. We also conducted a usability evaluation experiment to investigate the exercise effects of this system. We tried to evaluate quantitative exercise effects by measuring blood oxygen saturation level, the real-time ECG heart rate variability, and user body movement and angle change of Kinect skeleton. The experiment result showed that there was a statistically significant increase in heart rate and an increase in the amount of body movement when using the V-Catch Vision system. In the subjective evaluation, most subjects found the exercise using this system fun and satisfactory.

• Journal of the Korea Computer Graphics Society
• /
• v.28 no.2
• /
• pp.29-41
• /
• 2022

In this paper, we introduce a novel real-time, interactive animation system which uses real-time motion inputs from a low-cost motion-sensing device Kinect. Our system generates interaction motions between the user character and the counterpart character in real-time. While the motion of the user character is generated mimicking the user's input motion, the other character's motion is decided to react to the user avatar's motion. During a pre-processing step, our system analyzes the reference motion data and generates mapping model in advance. At run-time, our system first generates initial poses of two characters and then modifies them so that it could provide plausible interacting behavior. Our experimental results show plausible interacting animations in that the user character performs a modified motion of user input and the counterpart character properly reacts against the user character. The proposed method will be useful for developing real-time interactive animation systems which provide a better immersive experience for users.

• The Journal of Korean Academy of Sensory Integration
• /
• v.21 no.1
• /
• pp.34-46
• /
• 2023

Objective : The purpose of this study was to systematically analyze the methods by which virtual reality (VR)-based occupational therapy interventions are applied to disabled children and adolescents and to assess their effectiveness. Methods : The RISS, DBpia, KCI, Science Direct, and CINAHL MEDLINE databases were searched for relevant literature from January 2012 to August 2022. The main search terms used were "virtual reality," "work therapy," "youth," "virtual reality," "occupational therapy," "child," and "adolescent." A total of 16 documents were selected for analysis by the 4th stage of the PRISMA flowchart. Results : In the 16 selected studies, VR-based occupational therapy when used with children and adolescents with disabilities and was shown to have meaningful effects. Among the types of cerebral palsy covered in the studies, the most common was hemiplegia, and the evaluation tools used for measurement of the VR effect were daily activities, cognition, exercise technology, social-interaction technology, and visual-perception evaluation. Nintendo wii and Microsoft Kinect produced the VR tools most commonly used to improve motor skills and daily life. Conclusion : The results of this study indicate that VR interventions can be used effectively in clinical practice. In the future, they may assist in the diagnosis of disabled children and adolescents, in helping to select VR tools that are suitable for the purposes of intervention, and in the presentation of specific methods.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.23 no.6
• /
• pp.565-570
• /
• 2013

The mirror neuron regions which are distributed in cortical area handled a functionality of intention recognition on the basis of imitative learning of an observed action which is acquired from visual-information of a goal-directed action. In this paper an automated intention recognition system is proposed by applying computational model of mirror neuron system to the human-robot interaction system. The computational model of mirror neuron system is designed by using dynamic neural networks which have model input which includes sequential feature vector set from the behaviors from the target object and actor and produce results as a form of motor data which can be used to perform the corresponding intentional action through the imitative learning and estimation procedures of the proposed computational model. The intention recognition framework is designed by a system which has a model input from KINECT sensor and has a model output by calculating the corresponding motor data within a virtual robot simulation environment on the basis of intention-related scenario with the limited experimental space and specified target object.