• Title/Summary/Keyword: Linear classifier

Search Result 179, Processing Time 0.024 seconds

A Comparative Study of Image Recognition by Neural Network Classifier and Linear Tree Classifier (신경망 분류기와 선형트리 분류기에 의한 영상인식의 비교연구)

  • Young Tae Park
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.31B no.5
    • /
    • pp.141-148
    • /
    • 1994
  • Both the neural network classifier utilizing multi-layer perceptron and the linear tree classifier composed of hierarchically structured linear discriminating functions can form arbitrarily complex decision boundaries in the feature space and have very similar decision making processes. In this paper, a new method for automatically choosing the number of neurons in the hidden layers and for initalzing the connection weights between the layres and its supporting theory are presented by mapping the sequential structure of the linear tree classifier to the parallel structure of the neural networks having one or two hidden layers. Experimental results on the real data obtained from the military ship images show that this method is effective, and that three exists no siginificant difference in the classification acuracy of both classifiers.

  • PDF

TS Fuzzy Classifier Using A Linear Matrix Inequality (선형 행렬 부등식을 이용한 TS 퍼지 분류기 설계)

  • Kim, Moon-Hwan;Joo, Young-Hoon;Park, Jin-Bae
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.14 no.1
    • /
    • pp.46-51
    • /
    • 2004
  • his paper presents a novel design technique for the TS fuzzy classifier via linear matrix inequalities(LMI). To design the TS fuzzy classifier built by the TS fuzzy model, the consequent parameters are determined to maximize the classifier's performance. Differ from the conventional fuzzy classifier design techniques, convex optimization technique is used to resolve the determination problem. Consequent parameter identification problems are first reformulated to the convex optimization problem. The convex optimization problem is then efficiently solved by converting linear matrix inequality problems. The TS fuzzy classifier has the optimal consequent parameter via the proposed design procedure in sense of the minimum classification error. Simulations are given to evaluate the proposed fuzzy classifier; Iris data classification and Wisconsin Breast Cancer Database data classification. Finally, simulation results show the utility of the integrated linear matrix inequalities approach to design of the TS fuzzy classifier.

Design of Lazy Classifier based on Fuzzy k-Nearest Neighbors and Reconstruction Error (퍼지 k-Nearest Neighbors 와 Reconstruction Error 기반 Lazy Classifier 설계)

  • Roh, Seok-Beom;Ahn, Tae-Chon
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.20 no.1
    • /
    • pp.101-108
    • /
    • 2010
  • In this paper, we proposed a new lazy classifier with fuzzy k-nearest neighbors approach and feature selection which is based on reconstruction error. Reconstruction error is the performance index for locally linear reconstruction. When a new query point is given, fuzzy k-nearest neighbors approach defines the local area where the local classifier is available and assigns the weighting values to the data patterns which are involved within the local area. After defining the local area and assigning the weighting value, the feature selection is carried out to reduce the dimension of the feature space. When some features are selected in terms of the reconstruction error, the local classifier which is a sort of polynomial is developed using weighted least square estimation. In addition, the experimental application covers a comparative analysis including several previously commonly encountered methods such as standard neural networks, support vector machine, linear discriminant analysis, and C4.5 trees.

Optimized Polynomial Neural Network Classifier Designed with the Aid of Space Search Simultaneous Tuning Strategy and Data Preprocessing Techniques

  • Huang, Wei;Oh, Sung-Kwun
    • Journal of Electrical Engineering and Technology
    • /
    • v.12 no.2
    • /
    • pp.911-917
    • /
    • 2017
  • There are generally three folds when developing neural network classifiers. They are as follows: 1) discriminant function; 2) lots of parameters in the design of classifier; and 3) high dimensional training data. Along with this viewpoint, we propose space search optimized polynomial neural network classifier (PNNC) with the aid of data preprocessing technique and simultaneous tuning strategy, which is a balance optimization strategy used in the design of PNNC when running space search optimization. Unlike the conventional probabilistic neural network classifier, the proposed neural network classifier adopts two type of polynomials for developing discriminant functions. The overall optimization of PNNC is realized with the aid of so-called structure optimization and parameter optimization with the use of simultaneous tuning strategy. Space search optimization algorithm is considered as a optimize vehicle to help the implement both structure and parameter optimization in the construction of PNNC. Furthermore, principal component analysis and linear discriminate analysis are selected as the data preprocessing techniques for PNNC. Experimental results show that the proposed neural network classifier obtains better performance in comparison with some other well-known classifiers in terms of accuracy classification rate.

Support Vector Machine Based Arrhythmia Classification Using Reduced Features

  • Song, Mi-Hye;Lee, Jeon;Cho, Sung-Pil;Lee, Kyoung-Joung;Yoo, Sun-Kook
    • International Journal of Control, Automation, and Systems
    • /
    • v.3 no.4
    • /
    • pp.571-579
    • /
    • 2005
  • In this paper, we proposed an algorithm for arrhythmia classification, which is associated with the reduction of feature dimensions by linear discriminant analysis (LDA) and a support vector machine (SVM) based classifier. Seventeen original input features were extracted from preprocessed signals by wavelet transform, and attempts were then made to reduce these to 4 features, the linear combination of original features, by LDA. The performance of the SVM classifier with reduced features by LDA showed higher than with that by principal component analysis (PCA) and even with original features. For a cross-validation procedure, this SVM classifier was compared with Multilayer Perceptrons (MLP) and Fuzzy Inference System (FIS) classifiers. When all classifiers used the same reduced features, the overall performance of the SVM classifier was comprehensively superior to all others. Especially, the accuracy of discrimination of normal sinus rhythm (NSR), arterial premature contraction (APC), supraventricular tachycardia (SVT), premature ventricular contraction (PVC), ventricular tachycardia (VT) and ventricular fibrillation (VF) were $99.307\%,\;99.274\%,\;99.854\%,\;98.344\%,\;99.441\%\;and\;99.883\%$, respectively. And, even with smaller learning data, the SVM classifier offered better performance than the MLP classifier.

The Optimization of Fuzzy Prototype Classifier by using Differential Evolutionary Algorithm (차분 진화 알고리즘을 이용한 Fuzzy Prototype Classifier 최적화)

  • Ahn, Tae-Chon;Roh, Seok-Beom;Kim, Yong Soo
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.24 no.2
    • /
    • pp.161-165
    • /
    • 2014
  • In this paper, we proposed the fuzzy prototype pattern classifier. In the proposed classifier, each prototype is defined to describe the related sub-space and the weight value is assigned to the prototype. The weight value assigned to the prototype leads to the change of the boundary surface. In order to define the prototypes, we use Fuzzy C-Means Clustering which is the one of fuzzy clustering methods. In order to optimize the weight values assigned to the prototypes, we use the Differential Evolutionary Algorithm. We use Linear Discriminant Analysis to estimate the coefficients of the polynomial which is the structure of the consequent part of a fuzzy rule. Finally, in order to evaluate the classification ability of the proposed pattern classifier, the machine learning data sets are used.

A Study on Short-Term Load Forecasting System Using Data Mining (데이터 마이닝을 이용한 단기부하예측 시스템 연구)

  • Kim, Do-Wan;Park, Jin-Bae;Kim, Juhg-Chan;Joo, Young-Hoon
    • Proceedings of the KIEE Conference
    • /
    • 2003.11c
    • /
    • pp.588-591
    • /
    • 2003
  • This paper presents a new short-term load forecasting system using data mining. Since the electric load has very different pattern according to the day, it definitely gives rise to the forecasting error if only one forecasting model is used. Thus, to resolve this problem, the fuzzy model-based classifier and predictor are proposed for the forecasting of the hourly electric load. The proposed classifier is the multi-input and multi-output fuzzy system of which the consequent part is composed of the Bayesian classifier. The proposed classifier attempts to categorize the input electric load into Monday, Tuesday$\sim$Friday, Saturday, and Sunday electric load, Then, we construct the Takagi-Sugeno (T-S) fuzzy model-based predictor for each class. The parameter identification problem is converted into the generalized eigenvalue problem (GEVP) by formulating the linear matrix inequalities (LMIs). Finally, to show the feasibility of the proposed method, this paper provides the short-term load forecasting example.

  • PDF

Application of an Adaptive Incremental Classifier for Streaming Data (스트리밍 데이터에 대한 적응적 점층적 분류기의 적용)

  • Park, Cheong Hee
    • Journal of KIISE
    • /
    • v.43 no.12
    • /
    • pp.1396-1403
    • /
    • 2016
  • In streaming data analysis where underlying data distribution may be changed or the concept of interest can drift with the progress of time, the ability to adapt to concept drift can be very powerful especially in the process of incremental learning. In this paper, we develop a general framework for an adaptive incremental classifier on data stream with concept drift. A distribution, representing the performance pattern of a classifier, is constructed by utilizing the distance between the confidence score of a classifier and a class indicator vector. A hypothesis test is then performed for concept drift detection. Based on the estimated p-value, the weight of outdated data is set automatically in updating the classifier. We apply our proposed method for two types of linear discriminant classifiers. The experimental results on streaming data with concept drift demonstrate that the proposed adaptive incremental learning method improves the prediction accuracy of an incremental classifier highly.

A Support Vector Machine Based Voltage Stability Classifier (SVM 기반 전압안정도 분류 알고리즘)

  • Dosano, Rodel D.;Song, Hwa-Chang;Lee, Byong-Jun
    • Proceedings of the KIEE Conference
    • /
    • 2007.07a
    • /
    • pp.477-478
    • /
    • 2007
  • This paper proposes a new concept of support vector machine (SVM) based voltage stability classifier using time-series phasor data. The classifier, based on a linear SVM, can provide very effective signals for identification of long-term voltage stability. In addition, the SVM output is applicable as an voltage stability indicator when an amount of corrective controls are performed just to make the system reach around at the maximum deliverable point.

  • PDF

A Study on Application of the Multi-layor Perceptron to the Human Sensibility Classifier with Eletroencephalogram (뇌파의 감성 분류기로서 다층 퍼셉트론의 활용에 관한 연구)

  • Kim, Dong Jun
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.67 no.11
    • /
    • pp.1506-1511
    • /
    • 2018
  • This study presents a human sensibility evaluation method using neural network and multiple-template method on electroencephalogram(EEG). We used a multi-layer perceptron type neural network as the sensibility classifier using EEG signal. For our research objective, 10-channel EEG signals are collected from the healthy subjects. After the necessary preprocessing is performed on the acquired signals, the various EEG parameters are estimated and their discriminating performance is evaluated in terms of pattern classification capability. In our study, Linear Prediction(LP) coefficients are utilized as the feature parameters extracting the characteristics of EEG signal, and a multi-layer neural network is used for indicating the degree of human sensibility. Also, the estimation for human comfortableness is performed by varying temperature and humidity environment factors and our results showed that the proposed scheme achieved good performances for evaluation of human sensibility.