• Journal of Sensor Science and Technology
• /
• v.21 no.1
• /
• pp.28-33
• /
• 2012

The visual sensing of human hands plays an important part in many man-machine interaction/interface systems. Most existing visionbased hand detection techniques depend on the color cues of human skin. The RGB color image from a vision sensor is often transformed to another color space as a preprocessing of hand detection because the color space transformation is assumed to increase the detection accuracy. However, the actual effect of color space transformation has not been well investigated in literature. This paper discusses a comparative evaluation of the pixel classification performance of hand skin detection in four widely used color spaces; RGB, YIQ, HSV, and normalized rgb. The experimental results indicate that using the normalized red-green color values is the most reliable under different backgrounds, lighting conditions, individuals, and hand postures. The nonlinear classification of pixel colors by the use of a multilayer neural network is also proposed to improve the detection accuracy.

• Korean Journal of Computational Design and Engineering
• /
• v.21 no.1
• /
• pp.20-30
• /
• 2016

Recently immersive virtual reality (VR) becomes popular due to the advanced development of I/O interfaces and related SWs for effectively constructing VR environments. In particular, natural and intuitive manipulation of 3D virtual objects is still considered as one of the most important user interaction issues. This paper presents a comparative study on the manipulation and interaction of 3D virtual objects using different interfaces and interactions in three VR environments. The comparative study includes both quantitative and qualitative aspects. Three different experimental setups are 1) typical desktop-based VR using mouse and keyboard, 2) hand gesture-supported desktop VR using a Leap Motion sensor, and 3) immersive VR by wearing an HMD with hand gesture interaction using a Leap Motion sensor. In the desktop VR with hand gestures, the Leap Motion sensor is put on the desk. On the other hand, in the immersive VR, the sensor is mounted on the HMD so that the user can manipulate virtual objects in the front of the HMD. For the quantitative analysis, a task completion time and success rate were measured. Experimental tasks require complex 3D transformation such as simultaneous 3D translation and 3D rotation. For the qualitative analysis, various factors relating to user experience such as ease of use, natural interaction, and stressfulness were evaluated. The qualitative and quantitative analyses show that the immersive VR with the natural hand gesture provides more intuitive and natural interactions, supports fast and effective performance on task completion, but causes stressful condition.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.8 no.8
• /
• pp.1725-1731
• /
• 2004

The use of gestures provides an attractive alternate to cumbersome interface devices for human-computer interaction. This has motivated a very active research area concerned with computer vision-based analysis and interpretation of hand gestures. The most important issues in gesture recognition are the simplification of algorithm and the reduction of processing time. The mathematical morphology based on geometrical set theory is best used to perform the processing. A key idea of proposed algorithm in this paper is to apply morphological shape decomposition. The primitive elements extracted to a hand gesture include in very important information on the directivity of the hand gestures. Based on this characteristic, we proposed the morphological gesture recognition algorithm using feature vectors calculated to lines connecting the center points of a main-primitive element and sub-primitive elements. Through the experiment, we demonstrated the efficiency of proposed algorithm. Coupling natural interactions such as hand gesture with an appropriately designed interface is a valuable and powerful component in the building of TV switch navigating and video contents browsing system.

• Journal of Internet Computing and Services
• /
• v.4 no.4
• /
• pp.9-14
• /
• 2003

A GUI (graphical user interface) has been a dominant platform for HCI (human computer interaction). A GUI - based interaction has made computers simpler and easier to use. The GUI - based interaction, however, does not easily support the range of interaction necessary to meet users' needs that are natural. intuitive, and adaptive. In this paper, the modified BMA (block matching algorithm) is proposed to track a hand in a sequence of an image and to recognize it in each video frame in order to replace a mouse with a pointing device for a virtual reality. The HCI system with 30 frames per second is realized in this paper. The modified BMA is proposed to estimate a position of the hand and segmentation with an orientation of motion and a color distribution of the hand region for real - time processing. The experimental result shows that the modified BMA with the YCbCr (luminance Y, component blue, component red) color coordinate guarantees the real - time processing and the recognition rate. The hand tracking by the modified BMA can be applied to a virtual reclity or a game or an HCI system for the disable.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.4 no.4
• /
• pp.618-632
• /
• 2010

This paper presents a novel approach to control the augmented reality (AR) objects robustly in a marker-less AR system by fingertip tracking and hand pattern recognition. It is known that one of the promising ways to develop a marker-less AR system is using human's body such as hand or face for replacing traditional fiducial markers. This paper introduces a real-time method to manipulate the overlaid virtual objects dynamically in a marker-less AR system using both hands with a single camera. The left bare hand is considered as a virtual marker in the marker-less AR system and the right hand is used as a hand mouse. To build the marker-less system, we utilize a skin-color model for hand shape detection and curvature-based fingertip detection from an input video image. Using the detected fingertips the camera pose are estimated to overlay virtual objects on the hand coordinate system. In order to manipulate the virtual objects rendered on the marker-less AR system dynamically, a vision-based hand control interface, which exploits the fingertip tracking for the movement of the objects and pattern matching for the hand command initiation, is developed. From the experiments, we can prove that the proposed and developed system can control the objects dynamically in a convenient fashion.

• Journal of Digital Contents Society
• /
• v.15 no.4
• /
• pp.473-480
• /
• 2014

As the use of computer has been popularized these days, an active research is in progress to make much more convenient and natural interface compared to the existing user interfaces such as keyboard or mouse. For this reason, there is an increasing interest toward Microsoft's motion sensing module called Kinect, which can perform hand motions and speech recognition system in order to realize communication between people. Kinect uses its built-in sensor to recognize the main joint movements and depth of the body. It can also provide a simple speech recognition through the built-in microphone. In this paper, the goal is to use Kinect's depth value data, skeleton tracking and labeling algorithm to recognize information about the extraction and movement of hand, and replace the role of existing peripherals using a virtual mouse, a virtual keyboard, and a speech recognition.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.35 no.1A
• /
• pp.25-32
• /
• 2010

Recently a passenger ship and liner has been spread throughout men of diversity, the space and informations is not open to general passenger. Therefore security systems are necessary for special sailors to admit them. Although security systems has a variety usage methods which are organism recognition(finger printer, iritis and vein etc) a few years ago, these usages has a defect reusing other objects because of leaving a trace. Therefore this paper designs and implements using 3D Qube image password interface which hand gestures are recognized after acquiring from 2D input image for protective marker of finger printer.

• 한국HCI학회:학술대회논문집
• /
• 2006.02a
• /
• pp.136-141
• /
• 2006

가상 품평 또는 가상 훈련 시스템과 같은 고품질, 고정밀 가상현실 애플리케이션에서는 사용자에게 자연스러운 상호작용을 제공하기 위해 고정밀 핸드인터페이스 기술을 필요로 하고 있으나, 현재까지 개발된 상호작용 기술은 산업 현장에서 사용하기에는 어려움이 많다. 따라서 본 연구에서는 직관적이고 자연스러운 상호작용을 위한 기술로서 저항이나 광학 방식 등의 센서를 이용한 기존 연구에 비해 높은 해상도와 빠른 갱신율을 제공하는 절대 변위 센서를 사용한 고정밀 장갑형 핸드 인터페이스 장치 개발과 사용자에게 이질감을 주었던 기존의 투박한 실리던형 핸드 모델이 아닌 가변형 스킨매쉬 기법을 적용한 사실적 핸드 모델 가시화 기술 및 복잡하고 잦은 캘리브레이션 과정을 극복하기 위한 2 가지 형태의 간단한 손동작만으로도 정확하고 신속한 캘리브레이션 작업을 지원하는 매니지먼트 툴의 개발을 제시한다.

• Proceedings of the Korea Multimedia Society Conference
• /
• 2002.05c
• /
• pp.507-511
• /
• 2002

전자문서 환경에서의 annotation은 종이 문서 환경에 비하여 다양한 장점을 제공하기 때문에, 현재 웹 및 hand-held 환경을 기반으로 하는 여러 분야에서 응용 및 적용되고 있다. 한편 annotation 인터페이스 중 paper-like annotation interface (PLAi)는 직관적인 자유형 마킹 생성 및 최소의 작업 오버헤드 보장 둥의 장점을 제공한다. 그러나 현재의 annotation 시스템에서는 대부분 PLAi를 제외한 서로 다른 인터페이스를 사용하고 있으며 이는 모든 환경에 PLAi을 적용하기에는 기술적 혹은 사용성 측면에서 다수의 부정적인 요인을 포함하기 때문이다. 따라서 본 연구에서는 데스크탑 및 hand-held 등과 같은 다양한 환경에서도 적용 가능한 PLAi를 제안하고자 하며, 특히 자유형 마킹에 대한 인식 및 보정 인터랙션이 지원되는 지능형 annotation 입력 인터페이스를 설계한다. 그 결과 제안된 인터페이스의 인터랙션 기법들은 다양한 환경에서도 PLAi의 장점을 최대한 지원할 수 있는 동시에, e-Learing, 전자교범, 온라인 교정, 전자도서관, 전자책 등의 분야에 적용 가능하다.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2002.05a
• /
• pp.197-200
• /
• 2002

The current Inn technique is many problems that is permission of radio station using RF Wireless Modem, that is influence of geographic obstacle using radio wave, that is frequency interference, that is finiteness of frequency resources. In this paper, we are solved many elements, IM replaces RF Wireless Modem, we suggest transmission technique of correction message using mobile phone, we researched Interface Module development which is linkage of DGPS receiver and mobile phone. IM can transmit correction message passing RS-232 port and modem communication control. IM of base station is initialized RS-232 port and modem to move station for correction message transmission, IM waited response mode. IM of move station is initialized RS-232 port and modem, IM requests hand shaking to base station, completed connection establishment. Users are worked Differential surveying using receiving correction message between mobile phones.