• The Journal of the Korea Contents Association
• /
• v.9 no.7
• /
• pp.159-170
• /
• 2009

It is very important to extract the expression data and capture a face image from a video for online-based 3D face animation. In recently, there are many researches on vision-based approach that captures the expression of an actor in a video and applies them to 3D face model. In this paper, we propose an automatic data extraction system, which extracts and traces a face and expression data from realtime video inputs. The procedures of our system consist of three steps: face detection, face feature extraction, and face tracing. In face detection, we detect skin pixels using YCbCr skin color model and verifies the face area using Haar-based classifier. We use the brightness and color information for extracting the eyes and lips data related facial expression. We extract 10 feature points from eyes and lips area considering FAP defined in MPEG-4. Then, we trace the displacement of the extracted features from continuous frames using color probabilistic distribution model. The experiments showed that our system could trace the expression data to about 8fps.

• The Transactions of the Korea Information Processing Society
• /
• v.4 no.12
• /
• pp.3211-3218
• /
• 1997

This paper addresses an eye location algorithm which is essential process of human face tracking system for natural video-conferencing. In current video-conferencing systems, user's facial movements are restricted by fixed camera, therefore it is inconvenient to users. We Propose an eye location algorithm for automatic face tracking. Because, locations of other facial features guessed from locations of eye and scale of face in the image can be calculated using inter-ocular distance. Most previous feature extraction methods for face recognition system are approached under assumption that approximative face region or location of each facial feature is known. The proposed algorithm in this paper uses no prior information on the given image. It is not sensitive to backgrounds and lighting conditions. The proposed algorithm uses the valley representation as major information to locate eyes. The experiments have been performed for 213 frames of 17 people and show very encouraging results.

• Journal of Digital Contents Society
• /
• v.7 no.1
• /
• pp.67-74
• /
• 2006

In current video-conferencing systems. user's face movements are restricted by fixed camera, therefore it is inconvenient to users. To solve this problem, tracking of face movements is needed. Tracking using whole face needs much computing time and whole face is difficult to define as an one feature. Thus, using several feature points in face is more desirable to track face movements efficiently. This paper addresses an effective eye location algorithm which is essential process of automatic human face tracking system for natural video-conferencing. The location of eye is very important information for face tracking, as eye has most clear and simplest attribute in face. The proposed algorithm is applied to candidate face regions from the face region extraction. It is not sensitive to lighting conditions and has no restriction on face size and face with glasses. The proposed algorithm shows very encouraging results from experiments on video-conferencing environments.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2002.04a
• /
• pp.741-744
• /
• 2002

본 논문에서는 3D 모델의 눈 변형을 계산하기 위해 검출된 눈 형태를 이용한 눈 움직임 합성 방법을 제안하였다. 얼굴 특징들의 정확한 위치 측정과 추적은 MPEG-4 코딩 시스템을 기반으로 한 고품질 모델 개발에 중요하다. 매우 낮은 비트율의 영상회의 응용에서 시간의 경과에 따라 눈과 입술의 움직임을 정확히 추적하기 위해 얼굴 특징들의 정확한 위치 측정과 추적이 필요하다. 이들의 움직임은 코딩되어지고 원격지로 전송되어 질 수 있다. 애니메이션 기술은 얼굴 모델에서 움직임을 합성하는데 이용되어진다. 본 논문에서는 얼굴 특징 검출과 추적 알고리즘으로 잘 알려지고, 효과적으로 향상시킬 수 있는 휴리스틱 방법을 제안하겠다. 본 논문에서는 눈 움직임의 검출뿐만 아니라 추적, 모델링에도 초점을 두었다.

• Journal of Broadcast Engineering
• /
• v.21 no.6
• /
• pp.861-877
• /
• 2016

This paper first discusses the disadvantages of the existing CamShift Algorithm for real time face tracking, and then proposes a new Camshift Algorithm that performs better than the existing algorithm. The existing CamShift Algorithm shows unstable tracking when tracing similar colors in the background of objects. This drawback of the existing CamShift is resolved by using Kinect’s pixel-by-pixel depth information and the Skin Detection algorithm to extract candidate skin regions based on HSV color space. Additionally, even when the tracking object is not found, or when occlusion occurs, the feature point-based matching algorithm makes it robust to occlusion. By applying the improved CamShift algorithm to face tracking, the proposed real-time face tracking algorithm can be applied to various fields. The results from the experiment prove that the proposed algorithm is superior in tracking performance to that of existing TLD tracking algorithm, and offers faster processing speed. Also, while the proposed algorithm has a slower processing speed than CamShift, it overcomes all the existing shortfalls of the existing CamShift.

• Journal of Broadcast Engineering
• /
• v.11 no.4 s.33
• /
• pp.533-540
• /
• 2006

In this study we propose to use a facial motion capture technique to track facial motions and expressions effectively by using the stereo vision module, which has two CMOS IMAGE SENSORS. In the proposed tracking algorithm, a center point tracking technique and correlation tracking technique, based on neural networks, were used. Experimental results show that the two tracking techniques using stereo vision motion capture are able to track general face expressions at a 95.6% and 99.6% success rate, for 15 frames and 30 frames, respectively. However, the tracking success rates(82.7%,99.1%) of the center point tracking technique was far higher than those(78.7%,92.7%) of the correlation tracking technique, when lips trembled.

• Proceedings of the Korea Database Society Conference
• /
• 1995.12a
• /
• pp.165-168
• /
• 1995

본 논문은 비디오 연속 영상에서 얼굴의 위치를 추적하는 알고리즘에 관하여 기술한다. 컴퓨터 비젼에서 대량의 비디오 연속 영상내 물체 추적은 실시간에 처리되는 빠른 알고리즘이 요구된다. 기존의 방법은 형태에 기반한 알고리즘으로 물체의 회전, 크기 변화, 겹침 등에 대한 문제에 민감하여 여러 가지 어려움이 발생한다. 그러나 칼라를 이용한 알고리즘은 이러한 문제에 대하여 둔감하여 훨씬 효과적이다. 본 논문은 칼라 3D 히스토그램을 이용한 Swain과 Ballard의 역 투사(backprojection) 방법을 적용하여 비디오 연속 영상에서 얼굴의 위치를 빠르고 정확히 추적하는 알고리즘을 제안한다.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.146-149
• /
• 2009

Face detection and recognition in real-time video constitutes one of the recent topics in the field of computer vision. In this paper, we propose face detection and tracking algorithm using the skin color and haar-like feature in real-time video sequence. The proposed algorithm further includes color space to enhance the result using haar-like feature and skin color. Experiment results reveal the real-time video processing speed and improvement in the rate of tracking.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2013.11a
• /
• pp.1408-1411
• /
• 2013

객체의 인식과 추적은 컴퓨터 비전 및 영상처리 분야에서 연구가 활발히 진행되고 있다. 특히 얼굴을 인식하고 추적하는 기술은 많은 분야에서 응용될 수 있다. 기존에 연구되어 온 기준 프레임과 관찰 프레임 사이의 차를 이용하여 객체를 인식하고 추적하는 방식은 관찰 대상이 다수인 경우 동일성을 확보하기에는 어려움이 많다. 따라서 본 논문에서는 각각의 프레임에서 빠르게 얼굴 영역을 인식하고, 독립적으로 인지된 얼굴들의 동일성을 연결하는 방법을 제시한다. 제안된 방법의 유용성은 실험으로 검증하였으며, 어느 정도 의미 있는 결과를 관찰할 수 있었다.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.26 no.12
• /
• pp.1816-1825
• /
• 2022

In this paper, we propose a new approach for tracking each human in a surveillance camera network with various resolution cameras. When tracking human on multiple non-overlapping cameras, the traditional appearance features are easily affected by various camera viewing conditions. To overcome this limitation, the proposed system utilizes facial information along with appearance information. In general, human images captured by the surveillance camera are often low resolution, so it is necessary to be able to extract useful features even from low-resolution faces to facilitate tracking. In the proposed tracking scheme, texture-based face descriptor is exploited to extract features from detected face after face frontalization. In addition, when the size of the face captured by the surveillance camera is very small, a super-resolution technique that enlarges the face is also exploited. The experimental results on the public benchmark Dana36 dataset show promising performance of the proposed algorithm.