• 제목/요약/키워드: linear discriminant analysis

검색결과 341건 처리시간 0.022초

주성분 분석법과 선형판별 분석법을 이용한 최적화된 방사형 기저 함수 신경회로망 분류기의 설계 (Design of Optimized Radial Basis Function Neural Networks Classifier with the Aid of Principal Component Analysis and Linear Discriminant Analysis)

  • 김욱동;오성권
    • 한국지능시스템학회논문지
    • /
    • 제22권6호
    • /
    • pp.735-740
    • /
    • 2012
  • 본 연구에서는 주성분 분석법 및 선형 판별 분석법을 이용한 다항식 방사형 기저 함수 신경회로망 분류기의 설계 방법론을 소개한다. 주성분 분석법과 선형판별 분석법을 사용하여 주어진 데이터의 정보 손실을 최소화한 특징데이터를 생성하고 이를 다항식 방사형 기저함수 신경회로망의 입력데이터로 사용한다. 방사형 기저 함수 신경회로망의 은닉층은 FCM 클러스터링 알고리즘으로 구성되며 연결가중치는 1차 선형식을 사용하였다. 최적의 분류기 설계를 위해서 최근에 제안된 Artificial Bee Colony(ABC) 최적화 알고리즘을 사용하여 구조 및 파라미터를 동조하였다. ABC 알고리즘을 통해 주성분 분석법과 선형판별 분석법의 고유벡터의 수 및 FCM 클러스터링 알고리즘의 퍼지화 계수등의 파라미터를 동조한다. 제안된 분류기는 대표적인 Machine Learning(ML) 데이터를 사용하여 성능을 평가하며 기존 분류기와 성능을 비교한다.

High-dimensional linear discriminant analysis with moderately clipped LASSO

  • Chang, Jaeho;Moon, Haeseong;Kwon, Sunghoon
    • Communications for Statistical Applications and Methods
    • /
    • 제28권1호
    • /
    • pp.21-37
    • /
    • 2021
  • There is a direct connection between linear discriminant analysis (LDA) and linear regression since the direction vector of the LDA can be obtained by the least square estimation. The connection motivates the penalized LDA when the model is high-dimensional where the number of predictive variables is larger than the sample size. In this paper, we study the penalized LDA for a class of penalties, called the moderately clipped LASSO (MCL), which interpolates between the least absolute shrinkage and selection operator (LASSO) and minimax concave penalty. We prove that the MCL penalized LDA correctly identifies the sparsity of the Bayes direction vector with probability tending to one, which is supported by better finite sample performance than LASSO based on concrete numerical studies.

Face Recognition Based on Improved Fuzzy RBF Neural Network for Smar t Device

  • Lee, Eung-Joo
    • 한국멀티미디어학회논문지
    • /
    • 제16권11호
    • /
    • pp.1338-1347
    • /
    • 2013
  • Face recognition is a science of automatically identifying individuals based their unique facial features. In order to avoid overfitting and reduce the computational reduce the computational burden, a new face recognition algorithm using PCA-fisher linear discriminant (PCA-FLD) and fuzzy radial basis function neural network (RBFNN) is proposed in this paper. First, face features are extracted by the principal component analysis (PCA) method. Then, the extracted features are further processed by the Fisher's linear discriminant technique to acquire lower-dimensional discriminant patterns, the processed features will be considered as the input of the fuzzy RBFNN. As a widely applied algorithm in fuzzy RBF neural network, BP learning algorithm has the low rate of convergence, therefore, an improved learning algorithm based on Levenberg-Marquart (L-M) for fuzzy RBF neural network is introduced in this paper, which combined the Gradient Descent algorithm with the Gauss-Newton algorithm. Experimental results on the ORL face database demonstrate that the proposed algorithm has satisfactory performance and high recognition rate.

Two Dimensional Slow Feature Discriminant Analysis via L2,1 Norm Minimization for Feature Extraction

  • Gu, Xingjian;Shu, Xiangbo;Ren, Shougang;Xu, Huanliang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제12권7호
    • /
    • pp.3194-3216
    • /
    • 2018
  • Slow Feature Discriminant Analysis (SFDA) is a supervised feature extraction method inspired by biological mechanism. In this paper, a novel method called Two Dimensional Slow Feature Discriminant Analysis via $L_{2,1}$ norm minimization ($2DSFDA-L_{2,1}$) is proposed. $2DSFDA-L_{2,1}$ integrates $L_{2,1}$ norm regularization and 2D statically uncorrelated constraint to extract discriminant feature. First, $L_{2,1}$ norm regularization can promote the projection matrix row-sparsity, which makes the feature selection and subspace learning simultaneously. Second, uncorrelated features of minimum redundancy are effective for classification. We define 2D statistically uncorrelated model that each row (or column) are independent. Third, we provide a feasible solution by transforming the proposed $L_{2,1}$ nonlinear model into a linear regression type. Additionally, $2DSFDA-L_{2,1}$ is extended to a bilateral projection version called $BSFDA-L_{2,1}$. The advantage of $BSFDA-L_{2,1}$ is that an image can be represented with much less coefficients. Experimental results on three face databases demonstrate that the proposed $2DSFDA-L_{2,1}/BSFDA-L_{2,1}$ can obtain competitive performance.

월경 전후기 증상 정도 및 월경고통 유형 판별요인 (A Study on the Differentiation of Women with Perimenstrual Symptom Severity and Perimenstrual Distress Patterns)

  • 박영주;유호신
    • 여성건강간호학회지
    • /
    • 제4권1호
    • /
    • pp.123-138
    • /
    • 1998
  • The purpose of this study was to describe perimenstrual symptom severity levels and perimenstrual distress patterns of women. The study performed the discriminant analysis in which included seven factors : age, pariety, social support, menstrual socialization(mother's symptom, sister's symptom, and menstrual effect), attitude of sex role and depression. The subjects were 283 women that they were not pregnant or lactating, had at least one period in past three months, would understand the purpose of study and willingly accepted the participation. The data analysis was done by pc-SAS program after data collection from Nov. 20, 1997 to Dec. 18, 1997. The descriptive analysis was done to explore general characteristics of the subjects and the stepwise discriminant analysis was done to verify factors in relation to perimenstrual symptom severity levels(severe vs mild menstrual symptom group) and perimenstrual distress patterns(spasmodic vs congestive menstrual symptom group). The instruments were selected for this study from Interpersonal Support Evaluation List(ISEL) by Cohen and Hoberman(1983), Center for Epidemic Studies Depression(CES-D) by Radloff(1977), and Sex Role Attitude Scale by Yunok Suh(1995), Mother's symptom and sister's symptom measurements by Woods, Mitchell & Lentz(1995), and menstrual effect by Brooks-Gun & Ruble(1980). The major findings of this study are as follows : 1. Of the 283 women, 93 women(32.9%) were assessed to severe perimenstrual symptom group and 190 women(67.1%) were assessed to mild perimenstrual symptom group. Results from the stepwise discriminant analysis showed three factors, such as depression, menstrual effect, and age, significantly related to perimenstrual symptom severity and they explained 20% of the total variance. The linear discriminant equation included three factors related to perimenstrual symptom groups was showed(Z=1.445 depression+0.174 menstrual effect-0.054 age). The cutting score(Z) was 2.809. We classified the severe perimenstrual symptom group by more than the cutting score 2.809 and the mild perimenstrual symptom by less or equal than the cutting score 2.809. The correctedness of posterior probability from discriminant equation was 72% as two perimenstrual symptom group classifications. 2. Of the 264 women, 139 women(52.7%) were assessed to spasmodic perimenstrual distress group and women(47.3%) were assessed to congestive perimenstrual distress group. Results from the stepwise discriminant analysis showed two factors, such as depression, age, significantly related to perimenstrual distress groups and they explained 8% of the total variance. The linear discriminant equation included two factors related to perimenstrual distress group was showed(Z=-0.084 age-0.776 depression). The cutting score(Z) was -3.759. We classified the spasmodic perimenstrual distress group by more than cutting score -3.759 and the congestive perimenstrual distress group by less or equal than cutting score -3.759. The correctedness of posterior probability from discriminant equation was 65% as two perimenstrual distress group classifications.

  • PDF

An Improved method of Two Stage Linear Discriminant Analysis

  • Chen, Yarui;Tao, Xin;Xiong, Congcong;Yang, Jucheng
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제12권3호
    • /
    • pp.1243-1263
    • /
    • 2018
  • The two-stage linear discrimination analysis (TSLDA) is a feature extraction technique to solve the small size sample problem in the field of image recognition. The TSLDA has retained all subspace information of the between-class scatter and within-class scatter. However, the feature information in the four subspaces may not be entirely beneficial for classification, and the regularization procedure for eliminating singular metrics in TSLDA has higher time complexity. In order to address these drawbacks, this paper proposes an improved two-stage linear discriminant analysis (Improved TSLDA). The Improved TSLDA proposes a selection and compression method to extract superior feature information from the four subspaces to constitute optimal projection space, where it defines a single Fisher criterion to measure the importance of single feature vector. Meanwhile, Improved TSLDA also applies an approximation matrix method to eliminate the singular matrices and reduce its time complexity. This paper presents comparative experiments on five face databases and one handwritten digit database to validate the effectiveness of the Improved TSLDA.

A Study on the Face Recognition Using PCA Algorithm

  • 이준탁;곽려혜
    • 한국지능시스템학회논문지
    • /
    • 제17권2호
    • /
    • pp.252-258
    • /
    • 2007
  • In this paper, a face recognition algorithm system using Principal Component Analysis (PCA) is proposed. The algorithm recognized a person by comparing characteristics (features) of the face to those of known individuals of Intelligent Control Laboratory (ICONL) face database. Simulations are carried out to investigate the algorithm recognition performance, which classified the face as a face or non-face and then classified it as known or unknown one. Particularly, a Principal Components of Linear Discriminant Analysis (PCA + LDA) face recognition algorithm is also proposed in order to confirm the recognition performances and the adaptability of a proposed PCA for a certain specific system.

Characterization of Korean Porcelainsherds by Neutron Activation Analysis

  • Lee, Chul;Kang, Hyung-Tae;Kim, Seung-Won
    • Bulletin of the Korean Chemical Society
    • /
    • 제9권4호
    • /
    • pp.223-231
    • /
    • 1988
  • Some pattern recognition methods have been used to characterize Korean ancient porcelainsherds using their elemental composition as analyzed by instrumental neutron activation analysis. A combination of analytical data by means of statistical linear discriminant analysis(SLDA) has resulted in removal of redundant variables, optimal linear combination of meaningful variables and formulation of classification rules. The plot in the first-to-second discriminant scores has shown that the three distinct territorial regions exist among porcelainsherds of Kyungki, Chunbuk-Chungnam, and Chunnam, with respective efficiencies of 20/30, 22/27 and 14/15. Similar regions have been found to exist among punchong porcelain and ceradonsherds of Kyungki, Chungnam and Chunbuk, with respective efficiencies of 7/9, 15/16 and 6/6. Classification has been further attempted by statistical isolinear multiple component analysis(SIMCA), using the sample set selected appropriately through SLDA as training set. For this purpose, all analytical data have been used. An agreement has generally been found between two methods, i.e., SLDA and SIMCA.

심전도 신호기반 개인식별을 위한 텐서표현의 다선형 판별분석기법 (A Multilinear LDA Method of Tensor Representation for ECG Signal Based Individual Identification)

  • 임원철;곽근창
    • 스마트미디어저널
    • /
    • 제7권4호
    • /
    • pp.90-98
    • /
    • 2018
  • 심전도 신호는 기본적으로 심장의 전기적 활동에 포함되며 이를 통해 심박수 측정, 심장 박동의 리듬 검사, 심장 이상 진단, 정서 인식 및 생체 인식과 같은 다양한 목적으로 분석 및 활용된다. 본 논문의 목적은 다차원 데이터 배열인 텐서 특성을 가진 다선형 판별분석(MLDA: Multilinear Linear Discriminant Analysis) 기법을 이용하여 개인식별을 수행하고자 한다. MLDA는 상위 차원의 텐서를 포함하는 분류 문제에 대해서 차원 문제를 해결 할 수 있으며, 상호 연관된 부분 공간은 서로 다른 클래스를 구별하기 위해 사용될 수 있다. 제시된 방법의 성능을 검증하기 위해 Physionet의 MIT-BIH데이터베이스를 적용하였다. 이 데이터베이스에 대해 실험한 결과, MLDA는 기존 PCA와 LDA와 비교하여 개인식별 성능이 우수함을 확인하였다.

도시공원의 시장분할에 관한 연구 (A Study on Market Segmentation of Urban Park)

  • 홍성권
    • 한국조경학회지
    • /
    • 제20권2호
    • /
    • pp.18-26
    • /
    • 1992
  • The purpose of this study is to suggest a method for identifying target markets of potential urban park users by their sociodemographic variables. Data was classified into(ⅰ) users vs. nonusers ; (ⅱ) of chosen three urban parks ; or(ⅲ) users of each urban park then analyzed by discriminant analysis. The results showed that linear combination of selected sociodemographic variables could be used for identifying target markets in some cases. In general, season and sex were the most powerful discriminant variables. But the other cases were not satisfactory. The weak points of this study due to adapting secondary data for analysis were discussed.

  • PDF