• Title/Summary/Keyword: LDA(Linear Discriminant Analysis)

Search Result 170, Processing Time 0.024 seconds

Hybrid Pattern Recognition Using a Combination of Different Features

  • Choi, Sang-Il
    • Journal of the Korea Society of Computer and Information
    • /
    • v.20 no.11
    • /
    • pp.9-16
    • /
    • 2015
  • We propose a hybrid pattern recognition method that effectively combines two different features for improving data classification. We first extract the PCA (Principal Component Analysis) and LDA (Linear Discriminant Analysis) features, both of which are widely used in pattern recognition, to construct a set of basic features, and then evaluate the separability of each basic feature. According to the results of evaluation, we select only the basic features that contain a large amount of discriminative information for construction of the combined features. The experimental results for the various data sets in the UCI machine learning repository show that using the proposed combined features give better recognition rates than when solely using the PCA or LDA features.

Prosodic Break Index Estimation using LDA and Tri-tone Model (LDA와 tri-tone 모델을 이용한 운율경계강도 예측)

  • 강평수;엄기완;김진영
    • The Journal of the Acoustical Society of Korea
    • /
    • v.18 no.7
    • /
    • pp.17-22
    • /
    • 1999
  • In this paper we propose a new mixed method of LDA and tri-tone model to predict Korean prosodic break indices(PBI) for a given utterance. PBI can be used as an important cue of syntactic discontinuity in continuous speech recognition(CSR). The model consists of three steps. At the first step, PBI was predicted with the information of syllable and pause duration through the linear discriminant analysis (LDA) method. At the second step, syllable tone information was used to estimate PBI. In this step we used vector quantization (VQ) for coding the syllable tones and PBI is estimated by tri-tone model. In the last step, two PBI predictors were integrated by a weight factor. The proposed method was tested on 200 literal style spoken sentences. The experimental results showed 72% accuracy.

  • PDF

Face Recognition using LDA Mixture Model (LDA 혼합 모형을 이용한 얼굴 인식)

  • Kim Hyun-Chul;Kim Daijin;Bang Sung-Yang
    • Journal of KIISE:Software and Applications
    • /
    • v.32 no.8
    • /
    • pp.789-794
    • /
    • 2005
  • LDA (Linear Discriminant Analysis) provides the projection that discriminates the data well, and shows a very good performance for face recognition. However, since LDA provides only one transformation matrix over whole data, it is not sufficient to discriminate the complex data consisting of many classes like honan faces. To overcome this weakness, we propose a new face recognition method, called LDA mixture model, that the set of alf classes are partitioned into several clusters and we get a transformation matrix for each cluster. This detailed representation will improve the classification performance greatly. In the simulation of face recognition, LDA mixture model outperforms PCA, LDA, and PCA mixture model in terms of classification performance.

Facial Feature Extraction Using Energy Probability in Frequency Domain (주파수 영역에서 에너지 확률을 이용한 얼굴 특징 추출)

  • Choi Jean;Chung Yns-Su;Kim Ki-Hyun;Yoo Jang-Hee
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.43 no.4 s.310
    • /
    • pp.87-95
    • /
    • 2006
  • In this paper, we propose a novel feature extraction method for face recognition, based on Discrete Cosine Transform (DCT), Energy Probability (EP), and Linear Discriminant Analysis (LDA). We define an energy probability as magnitude of effective information and it is used to create a frequency mask in OCT domain. The feature extraction method consists of three steps; i) the spatial domain of face images is transformed into the frequency domain called OCT domain; ii) energy property is applied on DCT domain that acquire from face image for the purpose of dimension reduction of data and optimization of valid information; iii) in order to obtain the most significant and invariant feature of face images, LDA is applied to the data extracted using frequency mask. In experiments, the recognition rate is 96.8% in ETRI database and 100% in ORL database. The proposed method has been shown improvements on the dimension reduction of feature space and the face recognition over the previously proposed methods.

Dimensionality reduction for pattern recognition based on difference of distribution among classes

  • Nishimura, Masaomi;Hiraoka, Kazuyuki;Mishima, Taketoshi
    • Proceedings of the IEEK Conference
    • /
    • 2002.07c
    • /
    • pp.1670-1673
    • /
    • 2002
  • For pattern recognition on high-dimensional data, such as images, the dimensionality reduction as a preprocessing is effective. By dimensionality reduction, we can (1) reduce storage capacity or amount of calculation, and (2) avoid "the curse of dimensionality" and improve classification performance. Popular tools for dimensionality reduction are Principal Component Analysis (PCA), Linear Discriminant Analysis (LDA), and Independent Component Analysis (ICA) recently. Among them, only LDA takes the class labels into consideration. Nevertheless, it, has been reported that, the classification performance with ICA is better than that with LDA because LDA has restriction on the number of dimensions after reduction. To overcome this dilemma, we propose a new dimensionality reduction technique based on an information theoretic measure for difference of distribution. It takes the class labels into consideration and still it does not, have restriction on number of dimensions after reduction. Improvement of classification performance has been confirmed experimentally.

  • PDF

Study of Avatar Generation method using PCA and LDA (PCA와 LDA를 이용한 아바타 생성 기법에 관한 연구)

  • Kang, Chae-Mi;Ohn, Syng-Yep
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2003.11a
    • /
    • pp.555-558
    • /
    • 2003
  • 본 논문은 PCA(Principal Component Analysis)와 LDA(Linear Discriminant Analysis)를 적용하여 입력된 사용자 얼굴 사진과 가장 유사한 아바타를 자동으로 생성하기 위한 방법을 제안한다. 입력된 사진으로부터 알려진 영상처리 기법들을 이용하여 얼굴 영역을 추출하고, 추출된 얼굴로부터 얼굴 구성요소(눈썹,눈,코,입)를 추출한다. 추출된 얼굴 구성요소와 미리 분류하여 구축한 실제 얼굴 사진에서의 얼굴 구성요소 라이브러리를 PCA와 LDA를 적용하여 유사도를 계산한다. 최종적으로 계산된 유사도 값이 가장 큰 영상의 대표 아바타가 결과영상으로 나오게 된다. 실험결과 기존의 아바타 추출방법에서 드러난 입력영상과 2진화된 아바타 영상과의 속성 차이로 인한 문제점을 보안하고 좀 더 정확하고 자동화된 방법으로 아바타를 추출 할 수 있다는 것을 보였다.

  • PDF

Face Recognition based on PCA and LDA using Wavelet (웨이블릿을 이용한 PCA와 LDA 기반 얼굴인식)

  • Ahn, Hyo-Chang;Lee, June-Hwan;Rhee, Sang-Burm
    • Proceedings of the IEEK Conference
    • /
    • 2006.06a
    • /
    • pp.731-732
    • /
    • 2006
  • Limitations on the Linear Discriminant Analysis (LDA) for face recognition, such as the loss of generalization and the computational infeasibility, are addressed and illustrated for small number of samples. The Principal Component Analysis (PCA) followed by the LDA mapping may be an alternative that can overcome this limitation. We also show that processing time is reduced by wavelet transform.

  • PDF

Skin Color Segmentation Using LDA and Indexing Table (LDA와 인덱싱 테이블을 이용한 피부영역 검출방법)

  • 양희성;강호진;이준호
    • Proceedings of the IEEK Conference
    • /
    • 2000.09a
    • /
    • pp.341-344
    • /
    • 2000
  • 본 논문에서는 복잡한 배경이나 조명 변화가 심한 영상에서도 피부영역을 정확하게 검출할 수 있는 피부영역 검출방법을 제안한다. 제안된 방법은 오프라인(off-line) 훈련과정과 온라인(on-line) 검출과정의 두 단계로 나누어진다. 훈련단계에서는 다양한 조명하에서 얻은 피부영상과 배경영상으로 구성된 훈련영상을 다차원의 열벡터로 표현하고 열벡터에 LDA(linear discriminant analysis)를 적용하여 선형변환된 특징벡터를 가지고 인덱싱 테이블을 생성한다. 검출단계에서는 카메라로 들어온 칼라영상을 여러 개의 조각영상으로 나누고 각각의 조각영상에 대하여 LDA를 적용하여 선형변환된 특징벡터를 구한다. 구해진 특징벡터를 미리 생성한 LDA 인덱싱 테이블에서 찾아 피부영역을 검출한다. 제안된 방법을 조명을 변화시킨 다양한 영상에 적용하여 실험한 결과 검출률이 상당히 우수함을 알 수 있었다.

  • PDF

Comparative Analysis of Dimensionality Reduction Techniques for Advanced Ransomware Detection with Machine Learning (기계학습 기반 랜섬웨어 공격 탐지를 위한 효과적인 특성 추출기법 비교분석)

  • Kim Han Seok;Lee Soo Jin
    • Convergence Security Journal
    • /
    • v.23 no.1
    • /
    • pp.117-123
    • /
    • 2023
  • To detect advanced ransomware attacks with machine learning-based models, the classification model must train learning data with high-dimensional feature space. And in this case, a 'curse of dimension' phenomenon is likely to occur. Therefore, dimensionality reduction of features must be preceded in order to increase the accuracy of the learning model and improve the execution speed while avoiding the 'curse of dimension' phenomenon. In this paper, we conducted classification of ransomware by applying three machine learning models and two feature extraction techniques to two datasets with extremely different dimensions of feature space. As a result of the experiment, the feature dimensionality reduction techniques did not significantly affect the performance improvement in binary classification, and it was the same even when the dimension of featurespace was small in multi-class clasification. However, when the dataset had high-dimensional feature space, LDA(Linear Discriminant Analysis) showed quite excellent performance.

A Facial Feature Area Extraction Method for Improving Face Recognition Rate in Camera Image (일반 카메라 영상에서의 얼굴 인식률 향상을 위한 얼굴 특징 영역 추출 방법)

  • Kim, Seong-Hoon;Han, Gi-Tae
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.5 no.5
    • /
    • pp.251-260
    • /
    • 2016
  • Face recognition is a technology to extract feature from a facial image, learn the features through various algorithms, and recognize a person by comparing the learned data with feature of a new facial image. Especially, in order to improve the rate of face recognition, face recognition requires various processing methods. In the training stage of face recognition, feature should be extracted from a facial image. As for the existing method of extracting facial feature, linear discriminant analysis (LDA) is being mainly used. The LDA method is to express a facial image with dots on the high-dimensional space, and extract facial feature to distinguish a person by analyzing the class information and the distribution of dots. As the position of a dot is determined by pixel values of a facial image on the high-dimensional space, if unnecessary areas or frequently changing areas are included on a facial image, incorrect facial feature could be extracted by LDA. Especially, if a camera image is used for face recognition, the size of a face could vary with the distance between the face and the camera, deteriorating the rate of face recognition. Thus, in order to solve this problem, this paper detected a facial area by using a camera, removed unnecessary areas using the facial feature area calculated via a Gabor filter, and normalized the size of the facial area. Facial feature were extracted through LDA using the normalized facial image and were learned through the artificial neural network for face recognition. As a result, it was possible to improve the rate of face recognition by approx. 13% compared to the existing face recognition method including unnecessary areas.