• ETRI Journal
• /
• v.34 no.6
• /
• pp.932-941
• /
• 2012

A powerful interaction mechanism is one of the key elements for the success of smart TVs, which demand far more complex interactions than traditional TVs. This paper proposes a novel interface based on the famous touch interaction model but utilizes long-range bare hand tracking to emulate touch actions. To satisfy the essential requirements of high accuracy and immediate response, the proposed hand tracking algorithm adopts a fast color-based tracker but with modifications to avoid the problems inherent to those algorithms. By using online modeling and motion information, the sensitivity to the environment can be greatly decreased. Furthermore, several ideas to solve the problems often encountered by users interacting with smart TVs are proposed, resulting in a very robust hand tracking algorithm that works superbly, even for users with sleeveless clothing. In addition, the proposed algorithm runs at a very high speed of 82.73 Hz. The proposed interface is confirmed to comfortably support most touch operations, such as clicks, swipes, and drags, at a distance of three meters, which makes the proposed interface a good candidate for interaction with smart TVs.

• 한국HCI학회:학술대회논문집
• /
• 2006.02a
• /
• pp.142-147
• /
• 2006

3D 센서테이블은 디스플레이가 내장된 테이블 위에서 사용자의 맨손이 움직일 때 그것을 감지하고 반응하는 센싱정보를 처리하도록 만든 것으로 양안시차 방식의 3 차원 입체영상에서 보여지는 가상의 오브젝트와 사람과의 인터렉션이 가능하도록 설계되었다. 본 연구에서는 3 차원 공간에서의 맨손을 이용한 사람과 컴퓨터 간의 인터렉션 방법에 중점을 두고 있는데 맨손의 위치정보와 제스처를 알기 위해서 Electric Field Sensing 기법을 이용하였다. 현재 구현된 3D 센서테이블은 테이블로부터 30cm 이내의 거리에서 움직이는 맨손의 위치와 간단한 제스처를 인식할 수 있다. 이를 통해서 기존의 마우스나 키보드가 가졌던 3 차원 공간에서 사용할 때 불편했던 점들을 해소하고, 직관적이면서도 누구나 사용하기에 쉬운 인터페이스 방법을 제시함으로써 사람과 컴퓨터와의 인터렉션 방법을 확장시킬 수 있다. 또한 기존의 많은 연구에서 맨손을 이용한 기법들이 주로 2D 기반이었던 것에 비하여 본 시스템은 2D뿐 아니라 3 차원 공간에서도 활용할 수 있다는 장점을 가진다.

• Journal of the HCI Society of Korea
• /
• v.10 no.2
• /
• pp.65-71
• /
• 2015

In this paper, we present binocular augmented reality system with smartphones. With improvements of performance and resolution of recent smartphones, various virtual reality devices using smartphones and applications are appearing in the market. But the augmented reality system with smartphones are not that popular because of the lack of required technologies. In our work, we discuss about 3D mapping and tracking using computer vision. Also, we provide hybrid tracking using sensors in the smartphone which can handle the computer vision failure cases. Bare hand 3D interaction method in our system will be also presented.

• Journal of Korea Multimedia Society
• /
• v.16 no.6
• /
• pp.720-734
• /
• 2013

In this paper, we suggest an augmented reality authoring tool system that users can easily make augmented reality contents using hand gesture and marker-based interaction methods. The previous augmented reality authoring tools are focused on augmenting a virtual object and to interact with this kind of augmented reality contents, user used the method utilizing marker or sensor. We want to solve this limited interaction method problem by applying marker based interaction method and gesture interaction method using depth sensing camera, Kinect. In this suggested system, user can easily develop simple form of marker based augmented reality contents through interface. Also, not just providing fragmentary contents, this system provides methods that user can actively interact with augmented reality contents. This research provides two interaction methods, one is marker based method using two markers and the other is utilizing marker occlusion. In addition, by recognizing and tracking user's bare hand, this system provides gesture interaction method which can zoom-in, zoom-out, move and rotate object. From heuristic evaluation about authoring tool and compared usability about marker and gesture interaction, this study confirmed a positive result.

• English Language & Literature Teaching
• /
• v.10 no.1
• /
• pp.179-200
• /
• 2004

The purpose of this study is to investigate the adequacy of derivational approach and representational approach to syntactic theories in generative grammar. As the generative grammar is based on the derivational process of syntactic theories, it is suggested that derivational approach is more valid than representational approach. Move, Economy Principle, Local Economy and Label-free Phrase Structure in Minimalist framework support the preference of derivational approach to representational approach with the elimination of computational complexity, minimality, and label-free phrase structure. Syntactic structure is considered as the result of the interaction of the properties of lexical items containing probe and economy conditions constrained by bare output conditions. On the other hand, Pseudogapping in Lasnik(1999) is analyzed in terms of Object Shift, that is, overt raising to Spec of $Agr_o$ and the PF deletion of VP in representational approach. Hence, it is suggested that the combination of derivational and representational approaches to syntactic theories can be admitted in generative grammar.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.50 no.6
• /
• pp.201-211
• /
• 2013

In this paper, we propose a hand tracking and gesture recognition system. Our system employs a depth capture device to obtain 3D geometric information of user's bare hand. In particular, we build a flexible tracking volume and restrict the hand tracking area, so that we can avoid diverse problems caused by conventional object detection/tracking systems. The proposed system computes running average of the hand position, and tracking volume is actively adjusted according to the statistical information that is computed on the basis of uncertainty of the user's hand motion in the 3D space. Once the position of user's hand is obtained, then the system attempts to detect stretched fingers to recognize finger gesture of the user's hand. In order to test the proposed framework, we built a NUI system using the proposed technique, and verified that our system presents very stable performance even in the case that multiple objects exist simultaneously in the crowded environment, as well as in the situation that the scene is occluded temporarily. We also verified that our system ensures running speed of 24-30 frames per second throughout the experiments.

• Journal of Practical Engineering Education
• /
• v.16 no.4
• /
• pp.459-469
• /
• 2024

Optimizing text entry in extended reality (XR) is important. However, most studies have focused on inputting alphabetic characters, so there is still insufficient research on inputting Korean characters. As a follow-up to our previous research, this paper deals with the effects of keyboard layout and augmented position on Korean text entry in the XR environment. For this purpose, we developed a virtual keyboard environment using the representative Korean keyboard layout "Du-Beol-Sik" across three augmented positions: mid-air, physical planar surface, and palmar surface. After conducting an experiment, we analyzed the effects of keyboard layout and augmented position on text entry by comparing the results of our previous research (the effect of augmented position on text entry based on the international standard Korean keyboard layout 'Chon-Ji-In'). The analysis results confirmed that the virtual keyboard performed the best overall when augmented in mid-air regardless of the keyboard layout. It was also confirmed that the keyboard layout had little effect on text entry. Based on detailed analyses, we suggest directions for providing a virtual keyboard for Korean text entries in the future.