• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2009.01a
• /
• pp.341-345
• /
• 2009

We present an augmented reality (AR) application for cell phone where users put a virtual pet on their palms and play/interact with the pet by moving their hands and fingers naturally. The application is fundamentally based on hand/palm pose recognition and finger motion estimation, which is the main concern in this paper. We propose a fast and efficient hand/palm pose recognition method which uses natural features (e.g. direction, width, contour shape of hand region) extracted from a hand image with prior knowledge for hand shape or geometry (e.g. its approximated shape when a palm is open, length ratio between palm width and pal height). We also propose a natural interaction method which recognizes natural motion of fingers such as opening/closing palm based on fingertip tracking. Based on the proposed methods, we developed and tested the AR application on an ultra-mobile PC (UMPC).

• Journal of Digital Contents Society
• /
• v.10 no.2
• /
• pp.291-298
• /
• 2009

In this paper we proposed a vision based realtime hand gesture recognition method. To extract skin color, we translate RGB color space into YCbCr color space and use CbCr color for the final extraction. To find the center of extracted hand region we apply practical center point extraction algorithm. We use Kalman filter to tracking hand region and use HMM(Hidden Markov Model) algorithm (learning 6 type of hand gesture image) to recognize it. We demonstrated the effectiveness of our algorithm by some experiments.

• Journal of Biomedical Engineering Research
• /
• v.29 no.2
• /
• pp.114-121
• /
• 2008

Within 2 to 5 months after stroke, patients recover variable degrees of function, depending on the initial deficit. An impaired hand function is one of the most serious disability in chronic stroke patients. Therefore, to evaluate the extent of motor dysfunction in the hemiplegic hand is important in stroke rehabilitation. In this paper, motor recoveries in 8 chronic stroke patients with Fugl-Meyer (FM) and white matter changes before and after the training program with a designed bilateral symmetrical arm trainer (BSAT) system were examined. The training was performed at 1 hr/day, 5 days/week during 6weeks. In all patients, FM was significantly improved after the 6-week training. Diffusion tensor imaging (DTI) results showed that tractional anisotropy ratio (FAR) and fiber tracking ratio (FTR) in the posterior internal capsule were significantly increased after the training. It seemed that the cortical reorganization was induced by the 6 week training with the BSAT. In all parameters proposed this study, a significant correlation was found between these parameters (FAR and FTR) and motor recoveries. This study demonstrated that DTI technique could be useful in predicting motor recovery in chronic hemiparetic patients.

• Journal of Digital Contents Society
• /
• v.15 no.4
• /
• pp.473-480
• /
• 2014

As the use of computer has been popularized these days, an active research is in progress to make much more convenient and natural interface compared to the existing user interfaces such as keyboard or mouse. For this reason, there is an increasing interest toward Microsoft's motion sensing module called Kinect, which can perform hand motions and speech recognition system in order to realize communication between people. Kinect uses its built-in sensor to recognize the main joint movements and depth of the body. It can also provide a simple speech recognition through the built-in microphone. In this paper, the goal is to use Kinect's depth value data, skeleton tracking and labeling algorithm to recognize information about the extraction and movement of hand, and replace the role of existing peripherals using a virtual mouse, a virtual keyboard, and a speech recognition.

• The KIPS Transactions:PartB
• /
• v.17B no.5
• /
• pp.345-354
• /
• 2010

Visual tracking techniques for Augmented Reality are classified as either a marker tracking approach or a natural feature tracking approach. Marker-based tracking algorithms can be efficiently implemented sufficient to work in real-time on mobile devices. On the other hand, natural feature tracking methods require a lot of computationally expensive procedures. Most previous natural feature tracking methods include heavy feature extraction and pattern matching procedures for each of the input image frame. It is difficult to implement real-time augmented reality applications including the capability of natural feature tracking on low performance devices. The required computational time cost is also in proportion to the number of patterns to be matched. To speed up the natural feature tracking process, we propose a novel fast tracking method based on optical flow. We implemented the proposed method on mobile devices to run in real-time and be appropriately used with mobile augmented reality applications. Moreover, during tracking, we keep up the total number of feature points by inserting new feature points proportional to the number of vanished feature points. Experimental results showed that the proposed method reduces the computational cost and also stabilizes the camera pose estimation results.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.6 no.3
• /
• pp.445-451
• /
• 2002

In this paper, we propose a new tracking algorighm that achieves good tracking performance in manuevering targets while capping the computation load to "low". Kalman Filler (KF) is generally known to be poor in tracking maneuvering targets. IMM, on the other hand, compensates the weakness inherent in the mundane KF and is considered as a promising alternative for tracking maneuvering targets. However, IMM suffers from substantially increased computational load as the number of models increases. To remedy this problem, we propose a new method focused to reducing the computational load and attaining the desirable tracking performance at least as good that of IMM. It is achieved by essentially adopting the structure of IMM and injecting Optimal Two-Stage Kalman Estimator (OTSKE). The representative simulation shows a reduction in computational load with the proposed OTSKE but further reduction is shown achieved (by about 58%) with the Interacting Acceleration Compenstation (IAC)-OTSKE approach. approach.

• Journal of Korea Multimedia Society
• /
• v.23 no.4
• /
• pp.566-573
• /
• 2020

Computers are the most common tool when using the Internet and utilizing a mouse to select and execute objects. Eye tracking technology is welcomed as an alternative technology to help control computers for users who cannot use their hands due to their disabilities. However, the pointer execution method of the existing eye tracking technique causes many malfunctions. Therefore, in this paper, we developed a gaze tracking interface that combines voice commands to solve the malfunction problem when the upper limb disabled uses the existing gaze tracking technology to execute computer menus and objects. Usability verification was conducted through comparative experiments regarding the improvements of the malfunction. The upper limb disabled who are hand-impaired use eye tracking technology to move the pointer and utilize the voice commands, such as, "okay" while browsing the computer screen for instant clicks. As a result of the comparative experiments on the reduction of the malfunction of pointer execution with the existing gaze interfaces, we verified that our system, Eye-Voice, reduced the malfunction rate of pointer execution and is effective for the upper limb disabled to use.

• Journal of KIISE:Software and Applications
• /
• v.29 no.11
• /
• pp.851-859
• /
• 2002

This paper discusses the design of a working system that visually recognizes hand gestures for the control of a window based user interface. We present a method for tracking the fingertip of the index finger using a single camera. Our method is based on CAMSHIFT algorithm and performs better than the CAMSHIFT algorithm in that it tracks well particular hand poses used in the system in complex backgrounds. We describe how the location of the fingertip is mapped to a location on the monitor, and how it Is both necessary and possible to smooth the path of the fingertip location using a physical model of a mouse pointer. Our method is able to track in real time, yet not absorb a major share of computational resources. The performance of our system shows a great promise that we will be able to use this methodology to control computers in near future.

• Journal of Institute of Control, Robotics and Systems
• /
• v.11 no.12
• /
• pp.1045-1050
• /
• 2005

This paper describes a design experience of a low-cost 6 DOF spatial tracker system where relative low accuracy and relatively long ranges, wireless communication will be achieved by means of low cost accelerometers and gyros with contemporary microprocessor. However, there are two key problems; one is the bias drift problem and the other is that single or double integration of acceleration signal suffers not only from noise but also from nonlinear effects caused by gravity. To be specific, beginning and stopping of hand motions needs to be accurately detected to initiate and terminate integration process to get position and pose of the hand from accelerometer and gyro signals, since errors due to noise and/or hand-shaking motions accumulated by integration processes. Several experimental results are shown to validate our proposed algorithms.

• Journal of Institute of Control, Robotics and Systems
• /
• v.10 no.1
• /
• pp.73-80
• /
• 2004

We have developed a general purpose motion controller using an FPGA(Field Programmable Gate Array). The multi-PID controllers and GUI are implemented as a system-on-chip for multi-axis motion control. Comparing with the commercial motion controller LM 629, since it has multi-independent PID controllers, we have several advantages such as space effectiveness, low cost and lower power consumption. In order to test the performance of the proposed controller, motion of the robot hand is controlled. The robot hand has three fingers with 2 joints each. Finger movements show that tracking was very effective. Another experiment of balancing an inverted pendulum on a cart has been conducted to show the generality of the proposed FPGA PID controller. The controller has well maintained the balance of the pendulum.