• Journal of the Ergonomics Society of Korea
• /
• v.31 no.4
• /
• pp.577-583
• /
• 2012

Objective: This paper describes the process and results related to the development of gesture recognition-based natural user interface(NUI) for vehicle maintenance e-Training system. Background: E-Training refers to education training that acquires and improves the necessary capabilities to perform tasks by using information and communication technology(simulation, 3D virtual reality, and augmented reality), device(PC, tablet, smartphone, and HMD), and environment(wired/wireless internet and cloud computing). Method: Palm movement from depth camera is used as a pointing device, where finger movement is extracted by using OpenCV library as a selection protocol. Results: The proposed NUI allows trainees to control objects, such as cars and engines, on a large screen through gesture recognition. In addition, it includes the learning environment to understand the procedure of either assemble or disassemble certain parts. Conclusion: Future works are related to the implementation of gesture recognition technology for a multiple number of trainees. Application: The results of this interface can be applied not only in e-Training system, but also in other systems, such as digital signage, tangible game, controlling 3D contents, etc.

• 전자공학회논문지 IE
• /
• v.47 no.1
• /
• pp.12-21
• /
• 2010

In this paper, we suggest Location Recognition System using Sensor Network; it distinguishes locations. Furthermore, this paper proposes Intelligent Navigation System which presents the proper route for the user. INS evaluates the user's preference, tendency and environmental state using Sensor Network Module and current driving information. This system also uses Soft-computing method to learn and infer the person’s preference and tendency. This paper defines Intelligent Assistance Module (IAM) which is a connector in between a user and a robot; it is portable. All in all, we created a basic intelligent robot, Location Recognition System, and Environment Sensor Modules; we verified the proposed algorithm through computer simulations.

• Journal of Broadcast Engineering
• /
• v.25 no.4
• /
• pp.545-559
• /
• 2020

In this paper, we propose a content creation framework that enables users without programming experience to easily create interactive media content that responds to user gestures. In the proposed framework, users define the gestures they use and the media effects that respond to them by numbers, and link them in a text-based configuration file. In the proposed framework, the interactive media content that responds to the user's gesture is linked with the dynamic projection mapping module to track the user's location and project the media effects onto the user. To reduce the processing speed and memory burden of the gesture recognition, the user's movement is expressed as a gray scale motion history image. We designed a convolutional neural network model for gesture recognition using motion history images as input data. The number of network layers and hyperparameters of the convolutional neural network model were determined through experiments that recognize five gestures, and applied to the proposed framework. In the gesture recognition experiment, we obtained a recognition accuracy of 97.96% and a processing speed of 12.04 FPS. In the experiment connected with the three media effects, we confirmed that the intended media effect was appropriately displayed in real-time according to the user's gesture.

• ETRI Journal
• /
• v.35 no.6
• /
• pp.1105-1114
• /
• 2013

Owing to the large number of video programs available, a method for accessing preferred videos efficiently through personalized video summaries and clips is needed. The automatic recognition of user states when viewing a video is essential for extracting meaningful video segments. Although there have been many studies on emotion recognition using various user responses, electroencephalogram (EEG)-based research on preference recognition of videos is at its very early stages. This paper proposes classification models based on linear and nonlinear classifiers using EEG features of band power (BP) values and asymmetry scores for four preference classes. As a result, the quadratic-discriminant-analysis-based model using BP features achieves a classification accuracy of 97.39% (${\pm}0.73%$), and the models based on the other nonlinear classifiers using the BP features achieve an accuracy of over 96%, which is superior to that of previous work only for binary preference classification. The result proves that the proposed approach is sufficient for employment in personalized video segmentation with high accuracy and classification power.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.16 no.1
• /
• pp.221-225
• /
• 2016

This paper is about vision system that exhibits automatic examination of the conditions of fuses and relay boxes using a camera. Proposed vision system is composed of three parts: image acquisition, vision algorithm, and user interface. The image acquisition part is composed of illumination and optics. The vision algorithmis the examining part, using the grabbed fuse box image. Lastly, user interface is divided into two parts, user interface for registering features of fuse box and user interface for examination operation.

• MALSORI
• /
• no.53
• /
• pp.119-127
• /
• 2005

Speech recognition is one of the user interface technologies in commanding and controlling any terminal such as a TV, PC, cellular phone etc. in a ubiquitous environment. In controlling a terminal, the mismatch between training and testing causes rapid performance degradation. That is, the mismatch decreases not only the performance of the recognition system but also the reliability of that. Therefore, the performance degradation due to the mismatch caused by the change of the environment should be necessarily compensated. Whenever the environment changes, environment adaptation is performed using the user's speech and the background noise of the changed environment and the performance is increased by employing the models appropriately transformed to the changed environment. So far, the research on the environment compensation has been done actively. However, the compensation method for the effect of distant-talking speech has not been developed yet. Thus, in this paper we apply MLLR-based environment adaptation to compensate for the effect of distant-talking speech and the performance is improved.

• ETRI Journal
• /
• v.37 no.4
• /
• pp.793-803
• /
• 2015

We propose a novel HMI UI/UX for an in-vehicle infotainment system. Our proposed HMI UI comprises multimodal interfaces that allow a driver to safely and intuitively manipulate an infotainment system while driving. Our analysis of a touchscreen interface-based HMI UI/UX reveals that a driver's use of such an interface while driving can cause the driver to be seriously distracted. Our proposed HMI UI/UX is a novel manipulation mechanism for a vehicle infotainment service. It consists of several interfaces that incorporate a variety of modalities, such as speech recognition, a manipulating device, and hand gesture recognition. In addition, we provide an HMI UI framework designed to be manipulated using a simple method based on four directions and one selection motion. Extensive quantitative and qualitative in-vehicle experiments demonstrate that the proposed HMI UI/UX is an efficient mechanism through which to manipulate an infotainment system while driving.

• Journal of Integrative Natural Science
• /
• v.11 no.3
• /
• pp.131-138
• /
• 2018

In this paper, we have implemented speeches that utilized the emotion information of the user's speech and image matching and recommendation system. To classify the user's emotional information of speech, the emotional information of speech about the user's speech is extracted and classified using the PLP algorithm. After classification, an emotional DB of speech is constructed. Moreover, emotional color and emotional vocabulary through factor analysis are matched to one space in order to classify emotional information of image. And a standardized image recommendation system based on the matching of each keyword with the BM-GA algorithm for the data of the emotional information of speech and emotional information of image according to the more appropriate emotional information of speech of the user. As a result of the performance evaluation, recognition rate of standardized vocabulary in four stages according to speech was 80.48% on average and system user satisfaction was 82.4%. Therefore, it is expected that the classification of images according to the user's speech information will be helpful for the study of emotional exchange between the user and the computer.

• 한국HCI학회:학술대회논문집
• /
• 2008.02a
• /
• pp.348-353
• /
• 2008

This paper proposes a novel touch interface for recognizing user's touch pattern and understanding emotional information by eliciting natural user interaction. To classify physical touches, we represent the similarity between touches by analyzing touches based on its dictionary meaning and design the algorithm to recognize various touch patterns in real time. Finally we suggest the methodology to estimate user's emotional state based on touch.

• Journal of Korean Library and Information Science Society
• /
• v.22
• /
• pp.245-276
• /
• 1995

This study analyzed the process of information service and its factors in the cognitive viewpoint. And developed a conceptual model to help in developing future information systems and services. The results of this study were summarized as follows : 1) The paradigm of information user study is changing from the system-centered to the user-centered one. 2) The researchers describe the user's internal cognitive process as the starting point of the information service. 3) The user's personal cognitive process influence the process of the information service over. And the focus is a microscopic one including the factors of the perception and recognition of the stimulus, remembering and searching information, reasoning the rules, recognition of the patterns, formalization of the concepts, etc. 4) The information librarian performs the role as a knowledge/ information system interface, and his knowledge structure reflects the organization of that knowledge/information system. 5) The information librarians can perform their role as information specialists actively and offensively. And the performance of the librarians can be measured on the scales of the su n.0, pplying capability of relevant information and the client satisfaction.