• Educational Technology International
• /
• v.16 no.2
• /
• pp.141-166
• /
• 2015

The purpose of this study was to examine the effects of using visual stimulation and gesture, namely embodied language learning, on learning achievement and learner's course interest in the EFL classroom. To investigate the effectiveness of the proposed purpose, thirty two third-grade elementary school students participated and were assigned into four English learning class conditions (i.e., using animated graphic and gestures condition, using only animated graphic condition, using still pictures and gesture condition, and control condition). The research questions for this study are addressed below: (1) What differences are there in post and delayed learning achievement between imitating gesture group and non-imitating one and between animated graphic group and still picture one? (2) What differences are there in course interest between imitating gesture group and non-imitating one and between animated graphic group and still picture one? The Embodiment-based English learning system for this study was designed by using Microsoft's Kinect sensing devices. The results of this study revealed that students of imitating gesture group memorized and retained better words and sentence structure than those of the other groups. As for learner's course interest measurement, imitating gesture group showed a highly positive response to attention, relevance, and satisfaction for curriculum and using animated graphic influenced satisfaction as well. This finding can be attributed to the embodied cognition, which proposes that the body and the mind are inseparable in the constitution of cognition and thus students using visual simulation and imitating related gesture regard the embodied language learning approach more satisfactory and acceptable than the conventional ones.

• Smart Media Journal
• /
• v.4 no.1
• /
• pp.33-38
• /
• 2015

In this paper, we propose the methods not only to eliminate ELF(Extremely Low Frequency) EMI(Electro-Magnetic Interference) noice for extending recognition distance, but also to utilize the the PLN for detecting starting instance of a hand gesture using electric potential sensor. First, we measure strength of electric field generated in the smart devices such as TV and phone, and minimize EMI through efficient arrangement of the sensors. Meanwhile, we utilize the 60 Hz PLN to extract the starting point of hand gesture. Thereafter, we eliminate the PLN generated in the smart device and circuit of sensors. And then, we shield the sensors from an electric noise generated from devices. Finally, through analyzing the frequency components according to the gesture of target, we use the low pass filter and the Kalman filter for elimination of remaining electric noise. We analyze and evaluate the proposed ELF-band EMI eliminating method for non-contact remote sensing of the EPS(Electric Potential Sensor). Combined with a detecting technique of gesture starting point, the recognition distance for gestures has been proven to be extended to more than 3m, which is critical for real application.

• Journal of Korea Multimedia Society
• /
• v.19 no.2
• /
• pp.436-442
• /
• 2016

There are a lot of sports when you left the victory and the defeat of the match the referee subjective judgment. In particular, TaeKwonDo pumse How accurate a given action? Is important. Objectively evaluate the subjective opinion of victory and defeat in a sporting event and the technology to keep as evidence is required. This study was implemented a system for recognizing Taekwondo executed through the number of motion recognition device. Step Sensor also used to detect a user's location. This study evaluated the rate matching the standard gesture data and the motion data. Through multiple gesture recognition equipment was more accurate assessment of the Taekwondo action.

• Science of Emotion and Sensibility
• /
• v.14 no.4
• /
• pp.627-636
• /
• 2011

The purpose of this study is to develop the multi-modal interaction system. This system provides realistic and an immersive experience through multi-modal interaction. The system recognizes user behavior, intention, and attention, which overcomes the limitations of uni-modal interaction. The multi-modal interaction system is based upon gesture interaction methods, intuitive gesture interaction and attention evaluation technology. The gesture interaction methods were based on the sensors that were selected to analyze the accuracy of the 3-D gesture recognition technology using meta-analysis. The elements of intuitive gesture interaction were reflected through the results of experiments. The attention evaluation technology was developed by the physiological signal analysis. This system is divided into 3 modules; a motion cognitive system, an eye gaze detecting system, and a bio-reaction sensing system. The first module is the motion cognitive system which uses the accelerator sensor and flexible sensors to recognize hand and finger movements of the user. The second module is an eye gaze detecting system that detects pupil movements and reactions. The final module consists of a bio-reaction sensing system or attention evaluating system which tracks cardiovascular and skin temperature reactions. This study will be used for the development of realistic digital entertainment technology.

• Journal of the Korean Institute of Telematics and Electronics C
• /
• v.34C no.2
• /
• pp.61-70
• /
• 1997

Human-hand gestures have been used a means of communication among people for a long time, being interpreted as streams of tokens for a language. The signed language is a method of communication for hearing impaired person. Articulated gestures and postures of hands and fingers are commonly used for the signed language. This paper presents a system which recognizes the korean sign language (KSL) and translates the recognition results into a normal korean text and sound. A pair of data-gloves are used a sthe sensing device for detecting motions of hands and fingers. In this paper, we propose a dynamic gesture recognition mehtod by employing a fuzzy feature analysis method for efficient classification of hand motions, and applying a fuzzy min-max neural network to on-line pattern recognition.

• Journal of Korea Multimedia Society
• /
• v.24 no.3
• /
• pp.355-372
• /
• 2021

Recently, high-performance HMDs (Head-Mounted Display) are becoming wireless due to the growth of virtual reality technology. Accordingly, environmental constraints on the hardware usage are reduced, enabling multiple users to experience virtual reality within a single space simultaneously. Existing multi-user virtual reality platforms use the user's location tracking and motion sensing technology based on vision sensors and active markers. However, there is a decrease in immersion due to the problem of overlapping markers or frequent matching errors due to the reflected light. Goal of this study is to develop a multi-user virtual reality moving platform in a single space that can resolve sensing errors and user immersion decrease. In order to achieve this goal hybrid sensing technology was developed, which is the convergence of vision sensor technology for position tracking, IMU (Inertial Measurement Unit) sensor motion capture technology and gesture recognition technology based on smart gloves. In addition, integrated safety operation system was developed which does not decrease the immersion but ensures the safety of the users and supports multimodal feedback. A 6 m×6 m×2.4 m test bed was configured to verify the effectiveness of the multi-user virtual reality moving platform for four users.

• Electronics and Telecommunications Trends
• /
• v.30 no.6
• /
• pp.31-41
• /
• 2015

사람은 User Interface(UI)를 통해 기기와 접촉하고 활용하며, 서비스를 제공받는다. 대부분의 입력 도구들은 사용자의 접촉을 필요로 하기 때문에 기기에 접촉이 불가능한 상황에서는 사용자의 의도를 기기에 전달하기 어렵다. 본고에서는 접촉 없이 사용자 입력을 가능하게 하는 기술 중 적외선 근접센서에 기반을 둔 제스처 센싱기술을 소개한다.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 1996.06b
• /
• pp.83-87
• /
• 1996

A virtual reality system using video image is designed and implemented. A participant having 2{{{{ { 1} over { 2} }}}}DOF can interact with the computer-generated virtual object using her/his full body posture and gesture in the 3D virtual environment. The system extracts the necessary participant-related information by video-based sensing, and simulates the realistic interaction such as collision detection in the virtual environment. The resulting scene obtained by compositing video image of the participant and virtual environment is updated in near real time.

• The Optical Journal
• /
• s.161
• /
• pp.58-73
• /
• 2016

사람은 User Interface(UI)를 통해 기기와 접촉하고, 활용하며 서비스를 제공받는다. 대부분의 입력 도구들은 사용자의 접촉을 필요로 하기 때문에 기기에 접촉이 불가능한 상황에서는 사용자의 의도를 기기에 전달하기 어렵다. 본고에서는 접촉 없이 사용자의 입력을 가능하게 하는 기술 중 적외선 근접센서에 기반을 둔 제스처 센싱기술을 소개한다.

• Journal of Korea Multimedia Society
• /
• v.16 no.6
• /
• pp.720-734
• /
• 2013

In this paper, we suggest an augmented reality authoring tool system that users can easily make augmented reality contents using hand gesture and marker-based interaction methods. The previous augmented reality authoring tools are focused on augmenting a virtual object and to interact with this kind of augmented reality contents, user used the method utilizing marker or sensor. We want to solve this limited interaction method problem by applying marker based interaction method and gesture interaction method using depth sensing camera, Kinect. In this suggested system, user can easily develop simple form of marker based augmented reality contents through interface. Also, not just providing fragmentary contents, this system provides methods that user can actively interact with augmented reality contents. This research provides two interaction methods, one is marker based method using two markers and the other is utilizing marker occlusion. In addition, by recognizing and tracking user's bare hand, this system provides gesture interaction method which can zoom-in, zoom-out, move and rotate object. From heuristic evaluation about authoring tool and compared usability about marker and gesture interaction, this study confirmed a positive result.