• Title/Summary/Keyword: Linear Discriminant

Search Result 390, Processing Time 0.023 seconds

Graphical Methods for the Sensitivity Analysis in Discriminant Analysis

  • Jang, Dae-Heung;Anderson-Cook, Christine M.;Kim, Youngil
    • Communications for Statistical Applications and Methods
    • /
    • v.22 no.5
    • /
    • pp.475-485
    • /
    • 2015
  • Similar to regression, many measures to detect influential data points in discriminant analysis have been developed. Many follow similar principles as the diagnostic measures used in linear regression in the context of discriminant analysis. Here we focus on the impact on the predicted classification posterior probability when a data point is omitted. The new method is intuitive and easily interpretable compared to existing methods. We also propose a graphical display to show the individual movement of the posterior probability of other data points when a specific data point is omitted. This enables the summaries to capture the overall pattern of the change.

A Note on Linear SVM in Gaussian Classes

  • Jeon, Yongho
    • Communications for Statistical Applications and Methods
    • /
    • v.20 no.3
    • /
    • pp.225-233
    • /
    • 2013
  • The linear support vector machine(SVM) is motivated by the maximal margin separating hyperplane and is a popular tool for binary classification tasks. Many studies exist on the consistency properties of SVM; however, it is unknown whether the linear SVM is consistent for estimating the optimal classification boundary even in the simple case of two Gaussian classes with a common covariance, where the optimal classification boundary is linear. In this paper we show that the linear SVM can be inconsistent in the univariate Gaussian classification problem with a common variance, even when the best tuning parameter is used.

Nonlinear damage detection using linear ARMA models with classification algorithms

  • Chen, Liujie;Yu, Ling;Fu, Jiyang;Ng, Ching-Tai
    • Smart Structures and Systems
    • /
    • v.26 no.1
    • /
    • pp.23-33
    • /
    • 2020
  • Majority of the damage in engineering structures is nonlinear. Damage sensitive features (DSFs) extracted by traditional methods from linear time series models cannot effectively handle nonlinearity induced by structural damage. A new DSF is proposed based on vector space cosine similarity (VSCS), which combines K-means cluster analysis and Bayesian discrimination to detect nonlinear structural damage. A reference autoregressive moving average (ARMA) model is built based on measured acceleration data. This study first considers an existing DSF, residual standard deviation (RSD). The DSF is further advanced using the VSCS, and then the advanced VSCS is classified using K-means cluster analysis and Bayes discriminant analysis, respectively. The performance of the proposed approach is then verified using experimental data from a three-story shear building structure, and compared with the results of existing RSD. It is demonstrated that combining the linear ARMA model and the advanced VSCS, with cluster analysis and Bayes discriminant analysis, respectively, is an effective approach for detection of nonlinear damage. This approach improves the reliability and accuracy of the nonlinear damage detection using the linear model and significantly reduces the computational cost. The results indicate that the proposed approach is potential to be a promising damage detection technique.

A Study on the Differentiation of Women with Perimenstrual Symptom Severity and Perimenstrual Distress Patterns (월경 전후기 증상 정도 및 월경고통 유형 판별요인)

  • Park, Young-Joo;Ryu, Ho-Shin
    • Women's Health Nursing
    • /
    • v.4 no.1
    • /
    • pp.123-138
    • /
    • 1998
  • The purpose of this study was to describe perimenstrual symptom severity levels and perimenstrual distress patterns of women. The study performed the discriminant analysis in which included seven factors : age, pariety, social support, menstrual socialization(mother's symptom, sister's symptom, and menstrual effect), attitude of sex role and depression. The subjects were 283 women that they were not pregnant or lactating, had at least one period in past three months, would understand the purpose of study and willingly accepted the participation. The data analysis was done by pc-SAS program after data collection from Nov. 20, 1997 to Dec. 18, 1997. The descriptive analysis was done to explore general characteristics of the subjects and the stepwise discriminant analysis was done to verify factors in relation to perimenstrual symptom severity levels(severe vs mild menstrual symptom group) and perimenstrual distress patterns(spasmodic vs congestive menstrual symptom group). The instruments were selected for this study from Interpersonal Support Evaluation List(ISEL) by Cohen and Hoberman(1983), Center for Epidemic Studies Depression(CES-D) by Radloff(1977), and Sex Role Attitude Scale by Yunok Suh(1995), Mother's symptom and sister's symptom measurements by Woods, Mitchell & Lentz(1995), and menstrual effect by Brooks-Gun & Ruble(1980). The major findings of this study are as follows : 1. Of the 283 women, 93 women(32.9%) were assessed to severe perimenstrual symptom group and 190 women(67.1%) were assessed to mild perimenstrual symptom group. Results from the stepwise discriminant analysis showed three factors, such as depression, menstrual effect, and age, significantly related to perimenstrual symptom severity and they explained 20% of the total variance. The linear discriminant equation included three factors related to perimenstrual symptom groups was showed(Z=1.445 depression+0.174 menstrual effect-0.054 age). The cutting score(Z) was 2.809. We classified the severe perimenstrual symptom group by more than the cutting score 2.809 and the mild perimenstrual symptom by less or equal than the cutting score 2.809. The correctedness of posterior probability from discriminant equation was 72% as two perimenstrual symptom group classifications. 2. Of the 264 women, 139 women(52.7%) were assessed to spasmodic perimenstrual distress group and women(47.3%) were assessed to congestive perimenstrual distress group. Results from the stepwise discriminant analysis showed two factors, such as depression, age, significantly related to perimenstrual distress groups and they explained 8% of the total variance. The linear discriminant equation included two factors related to perimenstrual distress group was showed(Z=-0.084 age-0.776 depression). The cutting score(Z) was -3.759. We classified the spasmodic perimenstrual distress group by more than cutting score -3.759 and the congestive perimenstrual distress group by less or equal than cutting score -3.759. The correctedness of posterior probability from discriminant equation was 65% as two perimenstrual distress group classifications.

  • PDF

Design of Optimized Radial Basis Function Neural Networks Classifier with the Aid of Principal Component Analysis and Linear Discriminant Analysis (주성분 분석법과 선형판별 분석법을 이용한 최적화된 방사형 기저 함수 신경회로망 분류기의 설계)

  • Kim, Wook-Dong;Oh, Sung-Kwun
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.22 no.6
    • /
    • pp.735-740
    • /
    • 2012
  • In this paper, we introduce design methodologies of polynomial radial basis function neural network classifier with the aid of Principal Component Analysis(PCA) and Linear Discriminant Analysis(LDA). By minimizing the information loss of given data, Feature data is obtained through preprocessing of PCA and LDA and then this data is used as input data of RBFNNs. The hidden layer of RBFNNs is built up by Fuzzy C-Mean(FCM) clustering algorithm instead of receptive fields and linear polynomial function is used as connection weights between hidden and output layer. In order to design optimized classifier, the structural and parametric values such as the number of eigenvectors of PCA and LDA, and fuzzification coefficient of FCM algorithm are optimized by Artificial Bee Colony(ABC) optimization algorithm. The proposed classifier is applied to some machine learning datasets and its result is compared with some other classifiers.

A Multilinear LDA Method of Tensor Representation for ECG Signal Based Individual Identification (심전도 신호기반 개인식별을 위한 텐서표현의 다선형 판별분석기법)

  • Lim, Won-Cheol;Kwak, Keun-Chang
    • Smart Media Journal
    • /
    • v.7 no.4
    • /
    • pp.90-98
    • /
    • 2018
  • A Multilinear LDA Method of Tensor Representation for ECG Signal Based Individual Identification Electrocardiogram signals, included in the cardiac electrical activity, are often analyzed and used for various purposes such as heart rate measurement, heartbeat rhythm test, heart abnormality diagnosis, emotion recognition and biometrics. The objective of this paper is to perform individual identification operation based on Multilinear Linear Discriminant Analysis (MLDA) with the tensor feature. The MLDA can solve dimensional aspects of classification problems in high-dimensional tensor, and correlated subspaces can be used to distinguish between different classes. In order to evaluate the performance, we used MPhysionet's MIT-BIH database. The experimental results on this database showed that the individual identification by MLDA outperformed that by PCA and LDA.

A Study on Predicting Bankruptcy Discriminant Model for Small-Sized Venture Firms using Technology Evaluation Data (기술력평가 자료를 이용한 중소벤처기업 파산예측 판별모형에 관한 연구)

  • Sung Oong-Hyun
    • Journal of Korea Technology Innovation Society
    • /
    • v.9 no.2
    • /
    • pp.304-324
    • /
    • 2006
  • There were considerable researches by finance people trying to find out business ratios as predictors of corporate bankruptcy. However, such financial ratios usually lack theoretical justification to predict bankruptcy for technology-oriented small sized venture firms. This study proposes a bankruptcy predictive discriminant model using technology evaluation data instead of financial data, evaluates the model fit by the correct classification rate, cross-validation method and M-P-P method. The results indicate that linear discriminant model was found to be more appropriate model than the logistic discriminant model and 69% of original grouped data were correctly classified while 67% of future data were expected to be classified correctly.

  • PDF

Two Dimensional Slow Feature Discriminant Analysis via L2,1 Norm Minimization for Feature Extraction

  • Gu, Xingjian;Shu, Xiangbo;Ren, Shougang;Xu, Huanliang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.7
    • /
    • pp.3194-3216
    • /
    • 2018
  • Slow Feature Discriminant Analysis (SFDA) is a supervised feature extraction method inspired by biological mechanism. In this paper, a novel method called Two Dimensional Slow Feature Discriminant Analysis via $L_{2,1}$ norm minimization ($2DSFDA-L_{2,1}$) is proposed. $2DSFDA-L_{2,1}$ integrates $L_{2,1}$ norm regularization and 2D statically uncorrelated constraint to extract discriminant feature. First, $L_{2,1}$ norm regularization can promote the projection matrix row-sparsity, which makes the feature selection and subspace learning simultaneously. Second, uncorrelated features of minimum redundancy are effective for classification. We define 2D statistically uncorrelated model that each row (or column) are independent. Third, we provide a feasible solution by transforming the proposed $L_{2,1}$ nonlinear model into a linear regression type. Additionally, $2DSFDA-L_{2,1}$ is extended to a bilateral projection version called $BSFDA-L_{2,1}$. The advantage of $BSFDA-L_{2,1}$ is that an image can be represented with much less coefficients. Experimental results on three face databases demonstrate that the proposed $2DSFDA-L_{2,1}/BSFDA-L_{2,1}$ can obtain competitive performance.

A Study on Market Segmentation of Urban Park (도시공원의 시장분할에 관한 연구)

  • 홍성권
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.20 no.2
    • /
    • pp.18-26
    • /
    • 1992
  • The purpose of this study is to suggest a method for identifying target markets of potential urban park users by their sociodemographic variables. Data was classified into(ⅰ) users vs. nonusers ; (ⅱ) of chosen three urban parks ; or(ⅲ) users of each urban park then analyzed by discriminant analysis. The results showed that linear combination of selected sociodemographic variables could be used for identifying target markets in some cases. In general, season and sex were the most powerful discriminant variables. But the other cases were not satisfactory. The weak points of this study due to adapting secondary data for analysis were discussed.

  • PDF

An Improved method of Two Stage Linear Discriminant Analysis

  • Chen, Yarui;Tao, Xin;Xiong, Congcong;Yang, Jucheng
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.3
    • /
    • pp.1243-1263
    • /
    • 2018
  • The two-stage linear discrimination analysis (TSLDA) is a feature extraction technique to solve the small size sample problem in the field of image recognition. The TSLDA has retained all subspace information of the between-class scatter and within-class scatter. However, the feature information in the four subspaces may not be entirely beneficial for classification, and the regularization procedure for eliminating singular metrics in TSLDA has higher time complexity. In order to address these drawbacks, this paper proposes an improved two-stage linear discriminant analysis (Improved TSLDA). The Improved TSLDA proposes a selection and compression method to extract superior feature information from the four subspaces to constitute optimal projection space, where it defines a single Fisher criterion to measure the importance of single feature vector. Meanwhile, Improved TSLDA also applies an approximation matrix method to eliminate the singular matrices and reduce its time complexity. This paper presents comparative experiments on five face databases and one handwritten digit database to validate the effectiveness of the Improved TSLDA.