• Title/Summary/Keyword: Kernel machines

Search Result 86, Processing Time 0.019 seconds

Nonlinear Chemical Plant Modeling using Support Vector Machines: pH Neutralization Process is Targeted (SVM을 이용한 비선형 화학공정 모델링: pH 중화공정에의 적용 예)

  • Kim, Dong-Won;Yoo, Ah-Rim;Yang, Dae-Ryook;Park, Gwi-Tae
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.12 no.12
    • /
    • pp.1178-1183
    • /
    • 2006
  • This paper is concerned with the modeling and identification of pH neutralization process as nonlinear chemical system. The pH control has been applied to various chemical processes such as wastewater treatment, chemical, and biochemical industries. But the control of the pH is very difficult due to its highly nonlinear nature which is the titration curve with the steepest slope at the neutralization point. We apply SVM which have become an increasingly popular tool for machine teaming tasks such as classification, regression or detection to model pH process which has strong nonlinearities. Linear and radial basis function kernels are employed and each result has been compared. So SVH based on kernel method have been found to work well. Simulations have shown that the SVM based on the kernel substitution including linear and radial basis function kernel provides a promising alternative to model strong nonlinearities of the pH neutralization but also to control the system.

Intelligent Fault Diagnosis of Induction Motor Using Support Vector Machines (SVMs 을 이용한 유도전동기 지능 결항 진단)

  • Widodo, Achmad;Yang, Bo-Suk
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2006.11a
    • /
    • pp.401-406
    • /
    • 2006
  • This paper presents the fault diagnosis of induction motor based on support vector machine(SVMs). SVMs are well known as intelligent classifier with strong generalization ability. Application SVMs using kernel function is widely used for multi-class classification procedure. In this paper, the algorithm of SVMs will be combined with feature extraction and reduction using component analysis such as independent component analysis, principal component analysis and their kernel(KICA and KPCA). According to the result, component analysis is very useful to extract the useful features and to reduce the dimensionality of features so that the classification procedure in SVM can perform well. Moreover, this method is used to induction motor for faults detection based on vibration and current signals. The results show that this method can well classify and separate each condition of faults in induction motor based on experimental work.

  • PDF

The Use of Support Vector Machines for Fault Diagnosis of Induction Motors

  • Widodo, Achmad;Yang, Bo-Suk
    • Proceedings of the Korea Committee for Ocean Resources and Engineering Conference
    • /
    • 2006.11a
    • /
    • pp.46-53
    • /
    • 2006
  • This paper presents the fault diagnosis of induction motor based on support vector machine (SVMs). SVMs are well known as intelligent classifier with strong generalization ability. Application SVMs using kernel function is widely used for multi-class classification procedure. In this paper, the algorithm of SVMs will be combined with feature extraction and reduction using component analysis such as independent component analysis, principal component analysis and their kernel (KICA and KPCA). According to the result, component analysis is very useful to extract the useful features and to reduce the dimensionality of features so that the classification procedure in SVM can perform well. Moreover, this method is used to induction motor for faults detection based on vibration and current signals. The results show that this method can well classify and separate each condition of faults in induction motor based on experimental work.

  • PDF

An Automatic Diagnosis System for Hepatitis Diseases Based on Genetic Wavelet Kernel Extreme Learning Machine

  • Avci, Derya
    • Journal of Electrical Engineering and Technology
    • /
    • v.11 no.4
    • /
    • pp.993-1002
    • /
    • 2016
  • Hepatitis is a major public health problem all around the world. This paper proposes an automatic disease diagnosis system for hepatitis based on Genetic Algorithm (GA) Wavelet Kernel (WK) Extreme Learning Machines (ELM). The classifier used in this paper is single layer neural network (SLNN) and it is trained by ELM learning method. The hepatitis disease datasets are obtained from UCI machine learning database. In Wavelet Kernel Extreme Learning Machine (WK-ELM) structure, there are three adjustable parameters of wavelet kernel. These parameters and the numbers of hidden neurons play a major role in the performance of ELM. Therefore, values of these parameters and numbers of hidden neurons should be tuned carefully based on the solved problem. In this study, the optimum values of these parameters and the numbers of hidden neurons of ELM were obtained by using Genetic Algorithm (GA). The performance of proposed GA-WK-ELM method is evaluated using statical methods such as classification accuracy, sensitivity and specivity analysis and ROC curves. The results of the proposed GA-WK-ELM method are compared with the results of the previous hepatitis disease studies using same database as well as different database. When previous studies are investigated, it is clearly seen that the high classification accuracies have been obtained in case of reducing the feature vector to low dimension. However, proposed GA-WK-ELM method gives satisfactory results without reducing the feature vector. The calculated highest classification accuracy of proposed GA-WK-ELM method is found as 96.642 %.

Support vector machines with optimal instance selection: An application to bankruptcy prediction

  • Ahn Hyun-Chul;Kim Kyoung-Jae;Han In-Goo
    • Proceedings of the Korea Inteligent Information System Society Conference
    • /
    • 2006.06a
    • /
    • pp.167-175
    • /
    • 2006
  • Building accurate corporate bankruptcy prediction models has been one of the most important research issues in finance. Recently, support vector machines (SVMs) are popularly applied to bankruptcy prediction because of its many strong points. However, in order to use SVM, a modeler should determine several factors by heuristics, which hinders from obtaining accurate prediction results by using SVM. As a result, some researchers have tried to optimize these factors, especially the feature subset and kernel parameters of SVM But, there have been no studies that have attempted to determine appropriate instance subset of SVM, although it may improve the performance by eliminating distorted cases. Thus in the study, we propose the simultaneous optimization of the instance selection as well as the parameters of a kernel function of SVM by using genetic algorithms (GAs). Experimental results show that our model outperforms not only conventional SVM, but also prior approaches for optimizing SVM.

  • PDF

Hybrid Learning Algorithm for Improving Performance of Regression Support Vector Machine (회귀용 Support Vector Machine의 성능개선을 위한 조합형 학습알고리즘)

  • Jo, Yong-Hyeon;Park, Chang-Hwan;Park, Yong-Su
    • The KIPS Transactions:PartB
    • /
    • v.8B no.5
    • /
    • pp.477-484
    • /
    • 2001
  • This paper proposes a hybrid learning algorithm combined momentum and kernel-adatron for improving the performance of regression support vector machine. The momentum is utilized for high-speed convergence by restraining the oscillation in the process of converging to the optimal solution, and the kernel-adatron algorithm is also utilized for the capability by working in nonlinear feature spaces and the simple implementation. The proposed algorithm has been applied to the 1-dimension and 2-dimension nonlinear function regression problems. The simulation results show that the proposed algorithm has better the learning speed and performance of the regression, in comparison with those quadratic programming and kernel-adatron algorithm.

  • PDF

Doubly penalized kernel method for heteroscedastic autoregressive datay

  • Cho, Dae-Hyeon;Shim, Joo-Yong;Seok, Kyung-Ha
    • Journal of the Korean Data and Information Science Society
    • /
    • v.21 no.1
    • /
    • pp.155-162
    • /
    • 2010
  • In this paper we propose a doubly penalized kernel method which estimates both the mean function and the variance function simultaneously by kernel machines for heteroscedastic autoregressive data. We also present the model selection method which employs the cross validation techniques for choosing the hyper-parameters which aect the performance of proposed method. Simulated examples are provided to indicate the usefulness of proposed method for the estimation of mean and variance functions.

A kernel machine for estimation of mean and volatility functions

  • Shim, Joo-Yong;Park, Hye-Jung;Hwang, Chang-Ha
    • Journal of the Korean Data and Information Science Society
    • /
    • v.20 no.5
    • /
    • pp.905-912
    • /
    • 2009
  • We propose a doubly penalized kernel machine (DPKM) which uses heteroscedastic location-scale model as basic model and estimates both mean and volatility functions simultaneously by kernel machines. We also present the model selection method which employs the generalized approximate cross validation techniques for choosing the hyperparameters which affect the performance of DPKM. Artificial examples are provided to indicate the usefulness of DPKM for the mean and volatility functions estimation.

  • PDF

Relation Extraction Using Convolution Tree Kernel Expanded with Entity Features

  • Qian, Longhua;Zhou, Guodong;Zhu, Qiaomin;Qian, Peide
    • Proceedings of the Korean Society for Language and Information Conference
    • /
    • 2007.11a
    • /
    • pp.415-421
    • /
    • 2007
  • This paper proposes a convolution tree kernel-based approach for relation extraction where the parse tree is expanded with entity features such as entity type, subtype, and mention level etc. Our study indicates that not only can our method effectively capture both syntactic structure and entity information of relation instances, but also can avoid the difficulty with tuning the parameters in composite kernels. We also demonstrate that predicate verb information can be used to further improve the performance, though its enhancement is limited. Evaluation on the ACE2004 benchmark corpus shows that our system slightly outperforms both the previous best-reported feature-based and kernel-based systems.

  • PDF

Estimating multiplicative competitive interaction model using kernel machine technique

  • Shim, Joo-Yong;Kim, Mal-Suk;Park, Hye-Jung
    • Journal of the Korean Data and Information Science Society
    • /
    • v.23 no.4
    • /
    • pp.825-832
    • /
    • 2012
  • We propose a novel way of forecasting the market shares of several brands simultaneously in a multiplicative competitive interaction model, which uses kernel regression technique incorporated with kernel machine technique applied in support vector machines and other machine learning techniques. Traditionally, the estimations of the market share attraction model are performed via a maximum likelihood estimation procedure under the assumption that the data are drawn from a normal distribution. The proposed method is shown to be a good candidate for forecasting method of the market share attraction model when normal distribution is not assumed. We apply the proposed method to forecast the market shares of 4 Korean car brands simultaneously and represent better performances than maximum likelihood estimation procedure.