• The KIPS Transactions:PartB
• /
• v.17B no.5
• /
• pp.355-362
• /
• 2010

Face tracking is to estimate the motion of a non-rigid face together with a rigid head in 3D, and plays important roles in higher levels such as face/facial expression/emotion recognition. In this paper, we propose an AAM-based face tracking algorithm. AAM has been widely used to segment and track deformable objects, but there are still many difficulties. Particularly, it often tends to diverge or converge into local minima when a target object is self-occluded, partially or completely occluded. To address this problem, we utilize the scale invariant feature transform (SIFT). SIFT is an effective method for self and partial occlusion because it is able to find correspondence between feature points under partial loss. And it enables an AAM to continue to track without re-initialization in complete occlusions thanks to the good performance of global matching. We also register and use the SIFT features extracted from multi-view face images during tracking to effectively track a face across large pose changes. Our proposed algorithm is validated by comparing other algorithms under the above 3 kinds of occlusions.

• Journal of Information Technology Services
• /
• v.6 no.3
• /
• pp.241-249
• /
• 2007

This paper describes a real-time face tracking system using effective detector and Kalman filter. In the proposed system, an image is separated into a background and an object using a real-time updated face color for effective face detection. The face features are extracted using the five types of simple Haar-like features. The extracted features are reinterpreted using Principal Component Analysis (PCA), and interpreted principal components are used for Support Vector Machine (SVM) that classifies the faces and non-faces. The moving face is traced with Kalman filter, which uses the static information of the detected faces and the dynamic information of changes between previous and current frames. The proposed system sets up an initial skin color and updates a region of a skin color through a moving skin color in a real time. It is possible to remove a background which has a similar color with a skin through updating a skin color in a real time. Also, as reducing a potential-face region using a skin color, the performance is increased up to 50% when comparing to the case of extracting features from a whole region.

• ETRI Journal
• /
• v.26 no.6
• /
• pp.535-544
• /
• 2004

With video compression standards such as MPEG-4, a transmission error happens in a video-packet basis, rather than in a macroblock basis. In this context, we propose a semantic error prioritization method that determines the size of a video packet based on the importance of its contents. A video packet length is made to be short for an important area such as a facial area in order to reduce the possibility of error accumulation. To facilitate the semantic error prioritization, an efficient hardware algorithm for face tracking is proposed. The increase of hardware complexity is minimal because a motion estimation engine is efficiently re-used for face tracking. Experimental results demonstrate that the facial area is well protected with the proposed scheme.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.146-149
• /
• 2009

Face detection and recognition in real-time video constitutes one of the recent topics in the field of computer vision. In this paper, we propose face detection and tracking algorithm using the skin color and haar-like feature in real-time video sequence. The proposed algorithm further includes color space to enhance the result using haar-like feature and skin color. Experiment results reveal the real-time video processing speed and improvement in the rate of tracking.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.31 no.11C
• /
• pp.1071-1076
• /
• 2006

In this paper, we develop face and hand tracking for sign language recognition system. The system is divided into two stages; the initial and tracking stages. In initial stage, we use the skin feature to localize face and hands of signer. The ellipse model on CbCr space is constructed and used to detect skin color. After the skin regions have been segmented, face and hand blobs are defined by using size and facial feature with the assumption that the movement of face is less than that of hands in this signing scenario. In tracking stage, the motion estimation is applied only hand blobs, in which first and second derivative are used to compute the position of prediction of hands. We observed that there are errors in the value of tracking position between two consecutive frames in which velocity has changed abruptly. To improve the tracking performance, our proposed algorithm compensates the error of tracking position by using adaptive search area to re-compute the hand blobs. The experimental results indicate that our proposed method is able to decrease the prediction error up to 96.87% with negligible increase in computational complexity of up to 4%.

• Journal of Korea Multimedia Society
• /
• v.10 no.1
• /
• pp.26-35
• /
• 2007

We present a robust face tracking system from the sequence of video images based on effective detector and Kalman filter. To construct the effective face detector, we extract the face features using the five types of simple Haar-like features. Extracted features are reinterpreted using Principal Component Analysis (PCA), and interpreted principal components are used for Support Vector Machine (SVM) that classifies the faces and non-faces. We trace the moving face with Kalman filter, which uses the static information of the detected faces and the dynamic information of changes between previous and current frames. To make a real-time tracking system, we reduce processing time by adjusting the frequency of face detection. In this experiment, the proposed system showed an average tracking rate of 95.5% and processed at 15 frames per second. This means the system is robust enough to track faces in real-time.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.48 no.6
• /
• pp.88-95
• /
• 2011

An embedded mobile device mostly has lower computation power than a general purpose computer because of its relatively lower system specifications. Consequently, conventional face tracking and face detection methods, requiring complex algorithms for higher recognition rates, are unsuitable in a mobile environment aiming for real time detection. On the other hand, by applying a real-time tracking and detecting algorithm, we would be able to provide a two-way interactive multimedia service between an user and a mobile device thus providing a far better quality of service in comparison to a one-way service. Therefore it is necessary to develop a real-time face and eye tracking technique optimized to a mobile environment. For this reason, in this paper, we proposes a method of tracking horizontal face position of a user on a T-DMB device for enhancing the quality of 3D DMB content. The proposed method uses the orientation of edges to estimate the left and right boundary of the face, and by the color edge information, the horizontal position and size of face is determined finally to decide the horizontal face. The sobel gradient vector is projected vertically and candidates of face boundaries are selected, and we proposed a smoothing method and a peak-detection method for the precise decision. Because general face detection algorithms use multi-scale feature vectors, the detection time is too long on a mobile environment. However the proposed algorithm which uses the single-scale detection method can detect the face more faster than conventional face detection methods.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.26 no.12
• /
• pp.1816-1825
• /
• 2022

In this paper, we propose a new approach for tracking each human in a surveillance camera network with various resolution cameras. When tracking human on multiple non-overlapping cameras, the traditional appearance features are easily affected by various camera viewing conditions. To overcome this limitation, the proposed system utilizes facial information along with appearance information. In general, human images captured by the surveillance camera are often low resolution, so it is necessary to be able to extract useful features even from low-resolution faces to facilitate tracking. In the proposed tracking scheme, texture-based face descriptor is exploited to extract features from detected face after face frontalization. In addition, when the size of the face captured by the surveillance camera is very small, a super-resolution technique that enlarges the face is also exploited. The experimental results on the public benchmark Dana36 dataset show promising performance of the proposed algorithm.

• Proceedings of the IEEK Conference
• /
• 2003.11a
• /
• pp.317-320
• /
• 2003

In this paper, we present real-time, accurate face region detection and tracking technique for an intelligent surveillance system. It is very important to obtain the high-resolution images, which enables accurate identification of an object-of-interest. Conventional surveillance or security systems, however, usually provide poor image quality because they use one or more fixed cameras and keep recording scenes without any clue. We implemented a real-time surveillance system that tracks a moving person using pan-tilt-zoom (PTZ) cameras. While tracking, the region-of-interest (ROI) can be obtained by using a low-pass filter and background subtraction. Color information in the ROI is updated to extract features for optimal tracking and zooming. The experiment with real human faces showed highly acceptable results in the sense of both accuracy and computational efficiency.

• The Journal of Korea Robotics Society
• /
• v.4 no.3
• /
• pp.201-209
• /
• 2009

In this paper, we deal with the performance evaluation method of user identification and user tracking for intelligent robots using face images. This paper shows general approaches for standard evaluation methods to improve intelligent robot systems as well as their algorithms. The evaluation methods proposed in this paper can be combined with the evaluation methods for detection algorithms of face region and facial components to measure the overall performance of face recognition in intelligent robots.