• Journal of Internet Computing and Services
• /
• v.16 no.6
• /
• pp.11-21
• /
• 2015

As growing interest in Human-Computer Interaction(HCI), research on HCI has been actively conducted. Also with that, research on Natural User Interface/Natural User eXperience(NUI/NUX) that uses user's gesture and voice has been actively conducted. In case of NUI/NUX, it needs recognition algorithm such as gesture recognition or voice recognition. However these recognition algorithms have weakness because their implementation is complex and a lot of time are needed in training because they have to go through steps including preprocessing, normalization, feature extraction. Recently, Kinect is launched by Microsoft as NUI/NUX development tool which attracts people's attention, and studies using Kinect has been conducted. The authors of this paper implemented hand-mouse interface with outstanding intuitiveness using the physical features of a user in a previous study. However, there are weaknesses such as unnatural movement of mouse and low accuracy of mouse functions. In this study, we designed and implemented a hand mouse interface which introduce a new concept called 'Virtual monitor' extracting user's physical features through Kinect in real-time. Virtual monitor means virtual space that can be controlled by hand mouse. It is possible that the coordinate on virtual monitor is accurately mapped onto the coordinate on real monitor. Hand-mouse interface based on virtual monitor concept maintains outstanding intuitiveness that is strength of the previous study and enhance accuracy of mouse functions. Further, we increased accuracy of the interface by recognizing user's unnecessary actions using his concentration indicator from his encephalogram(EEG) data. In order to evaluate intuitiveness and accuracy of the interface, we experimented it for 50 people from 10s to 50s. As the result of intuitiveness experiment, 84% of subjects learned how to use it within 1 minute. Also, as the result of accuracy experiment, accuracy of mouse functions (drag(80.4%), click(80%), double-click(76.7%)) is shown. The intuitiveness and accuracy of the proposed hand-mouse interface is checked through experiment, this is expected to be a good example of the interface for controlling the system by hand in the future.

• Journal of the HCI Society of Korea
• /
• v.1 no.2
• /
• pp.43-50
• /
• 2006

A mirror is a familiar tool for human beings who have been seeing themselves through it for a long time since it was created. As evolving Digital Technology, many approaches about digital mirrors which reflect not only the light, but also the information have been studied. Traditional mirrors on the wall do not need any special control to perform their automatic visual feedbacks, reflecting lights. On the contrary, digital mirrors can actively provide more information to the user than the traditional ones. In this paper, we propose an active digital mirror system of which functions are changed according to the user-mirror distance. First of all, we investigated users' behaviors on mirrors and categorized the interactions by user-mirror distance. Based on the previous result, we designed the user interface of the mirror, and developed a prototype which has three recognition modules: a distance measuring module using infrared sensor arrays, a user recognition module by computer vision technique, and a control perception module using infrared sensor grid. In addition, the next steps for improving the user-centered digital mirror system, and the possibility for developing a mirror-shaped computer system were suggested.

• The KIPS Transactions:PartB
• /
• v.18B no.1
• /
• pp.21-28
• /
• 2011

A 3D face shape derived from 2D images may be useful in many applications, such as face recognition, face synthesis and human computer interaction. To do this, we develop a fast 3D Active Appearance Model (3D-AAM) method using depth estimation. The training images include specific 3D face poses which are extremely different from one another. The landmark's depth information of landmarks is estimated from the training image sequence by using the approximated Jacobian matrix. It is added at the test phase to deal with the 3D pose variations of the input face. Our experimental results show that the proposed method can efficiently fit the face shape, including the variations of facial expressions and 3D pose variations, better than the typical AAM, and can estimate accurate 3D face shape from images.

• The Journal of Korean Association of Computer Education
• /
• v.10 no.4
• /
• pp.125-133
• /
• 2007

Many researches have tried to introduce affective computing for Human-Computer Interaction (HCI). In the affective aspect, emotional memories significantly affect on people's cognitive processing activities. In this paper, to observe the effect of affective feedback for emotional state of learners in an e-learning environment, selected emotional feedback messages and delivery method are integrated into an e-learning system. Self reporting button for recognizing learner's emotional state are used for detecting learner's emotional states and the test results show that providing affective feedback to learner has positive effects in e-learning environment in terms of learner's academic achievements.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2021.07a
• /
• pp.601-604
• /
• 2021

본 논문에서는 모바일 디바이스의 카메라로부터 얻은 RGB이미지를 분석하여 장애물을 안정적으로 탐지할 수 있는 프레임워크를 제안한다. 본 논문에서는 장애물을 안정적으로 찾기 위해 RANSAC(Random Sample Consensus)기반의 다중 평면 방식을 이용한 위험감지 시스템을 제안한다. 우리의 접근 방식은 RGB영상으로부터 특징점(Feature point)을 추출하고, 특징점을 분석(Feature point analysis)하여 영상내의 평면을 감지한다. 복잡한 지형으로 인해 생성되는 다수의 평면을 RANSAC을 통해 단일 평면으로 정규화하고, 이로부터 특징점을 분류하기 위한 기준점을 계산한다. 모바일 디바이스의 위치와 회전 제약 없이 효과적으로 기준평면(Reference plane)을 탐색할 수 있고, 영상 내 특징점을 실시간으로 계산한다. 다양한 실험을 통해 기준평면과 장애물과의 거리를 파악하여 장애물을 효과적으로 분류하는 결과를 얻었다. 우리의 기법은 실세계에서의 위험요소를 감지하고 모바일 디바이스 사용자의 안전성 확보에 활용할 수 있을 거라 기대한다.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2022.01a
• /
• pp.377-380
• /
• 2022

본 논문에서는 모바일 기반 AR 환경에서 RGB카메라로부터 얻은 영상 분석과 DB 기반의 특징점(Feature point) 매칭을 통하여 보다 정확하게 위험 상황을 알려줄 수 있는 프레임워크를 제안한다. 본 논문에서는 RANSAC(Random sample consensus)기반의 다중 평면 방식을 이용한 특징점을 추출하고 분석하여 영상에 존재하는 장애물을 감지한다. RGB카메라로 얻은 영상을 기반으로 장애물을 검출하는 접근법은 영상에 의존하기 때문에 조명에 따른 특징점 검출이 부정확하고, 조명이나 자연광 또는 날씨에 영향을 많이 받기 때문에 어둡거나 흐린 날씨에서는 장애물 검출이 어려워진다. 이 문제를 완화하기 위해 본 논문에서는 DB기반의 특징점 매칭을 통해 조명에 관계없이 장애물을 효율적이고 정확하게 감지한다. 특징점 매칭을 이용하려면 우선 영상에서 특징점이 안정적으로 추출될 수 있는 환경인, 조명이나 자연광이 충분한 환경에서 감지된 장애물 정보를 데이터베이스화 하여 저장한다. 조명이 충분하지 않은 환경에서 사용자가 사전에 저장된 지역에 근접할 경우 특징점 분석이 아닌 DB 기반 특징점 매칭을 통해 위험 요소를 감지한다. 우리의 방법은 조명의 여부의 관계없이 효과적으로 위험을 감지할 수 있기 때문에 다양한 분야에 활용될 수 있다.

• Journal of Korea Multimedia Society
• /
• v.9 no.2
• /
• pp.234-243
• /
• 2006

The recent rapid development of HCI and surveillance technologies has brought great interests in application systems to process faces. Much of research efforts in these systems has been primarily focused on such areas as face recognition, facial expression analysis and facial feature extraction. However, not many approaches have been reported toward face direction detection. This paper proposes a method to detect the direction of a face using a facial feature called facial triangle, which is formed by two eyebrows and the lower lip. Specifically, based on the single monocular view of the face, the proposed method introduces very simple formulas to estimate the horizontal or vertical rotation angle of the face. The horizontal rotation angle can be calculated by using a ratio between the areas of left and right facial triangles, while the vertical angle can be obtained from a ratio between the base and height of facial triangle. Experimental results showed that our method makes it possible to obtain the horizontal angle within an error tolerance of ${\pm}1.68^{\circ}$, and that it performs better as the magnitude of the vertical rotation angle increases.

• Smart Media Journal
• /
• v.5 no.1
• /
• pp.38-43
• /
• 2016

As smart environment is spread out in our living environments, the needs of an approach related to Human Computer Interaction(HCI) is increases. One of them is head pose estimation. it related to gaze direction estimation, since head has a close relationship to eyes by the body structure. It's a key factor in identifying person's intention or the target of interest, hence it is an essential research in HCI. In this paper, we propose an approach for head pose estimation with pre-defined several directions by random forest classifier. We use canny edge detector to extract feature of the different facial image which is obtained between input image and averaged frontal facial image for extraction of rotation information of input image. From that, we obtain the binary edge image, and make two accumulated histograms which are obtained by counting the number of pixel which has non-zero value along each of the axes. This two accumulated histograms are used to feature of the facial image. We use CAS-PEAL-R1 Dataset for training and testing to random forest classifier, and obtained 80.6% accuracy.

• Journal of Convergence for Information Technology
• /
• v.11 no.1
• /
• pp.20-27
• /
• 2021

Eye tracking is one of the NUI technologies, and it finds out where the user is gazing. This technology allows users to input text or control GUI, and further analyzes the user's gaze so that it can be applied to commercial advertisements. In the eye tracking system, the allowable range varies depending on the quality of the image and the degree of freedom of movement of the user. Therefore, there is a need for a method of estimating the accuracy of eye tracking in advance. The accuracy of eye tracking is greatly affected by how the eye tracking algorithm is implemented in addition to hardware variables. Accordingly, in this paper, we propose a method to estimate how many degrees of gaze changes when the pupil center moves by one pixel by estimating the maximum possible movement distance of the pupil center in the image.

• Journal of the Korean BIBLIA Society for library and Information Science
• /
• v.22 no.1
• /
• pp.247-262
• /
• 2011

Although research has shown a significant amount of work identifying various dimensions of relevance along with exhaustive lists of relevance criteria, there seem to have been less effort to apply the findings to improve actual systems design. Based on this assumption, this paper investigates to what extent those relevance criteria have been incorporated into the interface features of major commercial Web search engines, suggesting what can/should be done more. Before stepping into the actual system features, this paper compares recent relevance research in Information Science with other human factor studies both in Information Science and its neighboring discipline (HCI), as an attempt to identify studies that are conceptually similar to the relevance research, but not named as such way. Similarities and differences between these studies are presented. Recommendations suggested to support applicable interface features include: 1) further personalization of interface designs; 2) author-supplied meta tags for the Web contents; and 3) extensions of beyond-topical representations based on link structure.