• Communications for Statistical Applications and Methods
• /
• v.20 no.6
• /
• pp.491-498
• /
• 2013

We consider support vector machines(SVM) to predict Y with p numerical variables $X_1$, ${\ldots}$, $X_p$. This paper aims to build a biplot of p explanatory variables, in which the first dimension indicates the direction of SVM classification and/or regression fits. We use the geometric scheme of kernel principal component analysis adapted to map n observations on the two-dimensional projection plane of which one axis is determined by a SVM model a priori.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.17 no.6
• /
• pp.773-785
• /
• 2014

For decades, modeling of pilots has been intensively studied due to its advantages in reducing costs for training and enhancing safety of pilots. In particular, research for modeling of pilots' non-kinetic behaviors which refer to the decisions made by pilots is beneficial as the expertise of pilots can be inherent in the models. With the recent growth in the amount of combat logs accumulated, employing statistical learning methods for the modeling becomes possible. However, the combat logs consist of heterogeneous data that are not only continuous or discrete but also sequence independent or dependent, making it difficult to directly applying the learning methods without modifications. Therefore, in this paper, we present a kernel function named hybrid sequence kernel which addresses the problem by using multiple kernel learning methods. Based on the empirical experiments by using combat logs obtained from a simulator, the proposed kernel showed satisfactory results.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.30 no.1
• /
• pp.55-74
• /
• 2005

Bankruptcy prediction has drawn a lot of research interests in previous literature, and recent studies have shown that machine learning techniques achieved better performance than traditional statistical ones. This paper employs a relatively new machine learning technique, support vector machines (SVMs). to bankruptcy prediction problem in an attempt to suggest a new model with better explanatory power and stability. To serve this purpose, we use grid search technique using 5-fold cross-validation to find out the optimal values of the parameters of kernel function of SVM. In addition, to evaluate the prediction accuracy of SVM. we compare its performance with multiple discriminant analysis (MDA), logistic regression analysis (Logit), and three-layer fully connected back-propagation neural networks (BPNs). The experiment results show that SVM outperforms the other methods.

• ETRI Journal
• /
• v.41 no.5
• /
• pp.684-695
• /
• 2019

In a cloud environment, performance degradation, or even downtime, of virtual machines (VMs) usually appears gradually along with anomalous states of VMs. To better characterize the state of a VM, all possible performance metrics are collected. For such high-dimensional datasets, this article proposes a feature extraction algorithm based on unsupervised fuzzy linear discriminant analysis with kernel (UFKLDA). By introducing the kernel method, UFKLDA can not only effectively deal with non-Gaussian datasets but also implement nonlinear feature extraction. Two sets of experiments were undertaken. In discriminability experiments, this article introduces quantitative criteria to measure discriminability among all classes of samples. The results show that UFKLDA improves discriminability compared with other popular feature extraction algorithms. In detection accuracy experiments, this article computes accuracy measures of an anomaly detection algorithm (i.e., C-SVM) on the original performance metrics and extracted features. The results show that anomaly detection with features extracted by UFKLDA improves the accuracy of detection in terms of sensitivity and specificity.

• Journal of the Chungcheong Mathematical Society
• /
• v.29 no.4
• /
• pp.631-642
• /
• 2016

This article deals with one-dimension backward heat conduction problem (BHCP). A new approach based on least squares support vector machines (LS-SVM) is proposed for obtaining their approximate solutions. The approximate solution is presented in closed form by means of LS-SVM, whose parameters are adjusted to minimize an appropriate error function. The approximate solution consists of two parts. The first part is a known function that satisfies initial and boundary conditions. The other is a product of two terms. One term is known function which has zero boundary and initial conditions, another term is unknown which is related to kernel functions. This method has been successfully tested on practical examples and has yielded higher accuracy and stable solutions.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2003.11a
• /
• pp.537-543
• /
• 2003

Condition monitoring and fault diagnosis of machines are gaining importance in the industry because of the need to increase reliability and to decrease possible loss of production due to machine breakdown. By comparing the vibration signals of a machine running in normal and faulty conditions, detection of faults like mass unbalance, shaft misalignment and bearing defects is possible. This paper presents a novel approach for applying the fault diagnosis of rotating machinery. To detect multiple faults in rotating machinery, a feature selection method and support vector machine (SVM) based multi-class classifier are constructed and used in the faults diagnosis. The results in experiments prove that fault types can be diagnosed by the above method.

• Communications for Statistical Applications and Methods
• /
• v.29 no.2
• /
• pp.193-202
• /
• 2022

Semi-supervised learning has gained significant attention in recent applications. In this article, we provide a selective overview of popular semi-supervised methods and then propose a simple but effective algorithm for semi-supervised classification using support vector machines (SVM), one of the most popular binary classifiers in a machine learning community. The idea is simple as follows. First, we apply the dimension reduction to the unlabeled observations and cluster them to assign labels on the reduced space. SVM is then employed to the combined set of labeled and unlabeled observations to construct a classification rule. The use of SVM enables us to extend it to the nonlinear counterpart via kernel trick. Our numerical experiments under various scenarios demonstrate that the proposed method is promising in semi-supervised classification.

• Proceedings of the Korean Information Science Society Conference
• /
• 2005.07b
• /
• pp.715-717
• /
• 2005

Support vector machine(SVM)은 최근 각광받는 기계학습 방법 중 하나로서, kernel function 이라는 사상(mapping)을 이용하여 입력 공간의 벡터를 classification이 용이한 특징 (feature) 공간의 벡터로 변환하는 것을 근간으로 한다. SVM은 이러한 특징 공간에서 두 클래스를 구분 짓는 hyperplane을 일련의 최적화 방법론을 사용하여 찾아내며, 주어진 문제가 convex problem 인 경우 항상 global optimal solution 을 보장하는 등의 장점을 지닌다. 한편 bioinformatics 연구에서 주로 사용되는 데이터는 측정 오류 등 일련의 오류를 포함하고 있으며, 이러한 오류는 기계학습 방법론이 어떤 decision boundary를 찾아내는가에 영향을 끼치게 된다. 특히 SVM의 경우 이러한 오류는 특징 공간 벡터간의 관계를 나타내는 Gram matrix를 변화로 나타나게 된다. 본 연구에서는 입력 공간에 오류가 발생할 때 그것이 SVM 의 decision boundary를 어떻게 변화시키는가를 대표적인 두 가지 kernel function, 즉 linear kernel과 Gaussian kernel에 대해 분석하였다. Wisconsin대학의 유방암(breast cancer) 데이터에 대해 실험한 결과, 데이터의 오류에 따른 SVM 의 classification 성능 변화 양상을 관찰하여 커널의 종류에 따라 SVM이 어떠한 특성을 보이는가를 밝혀낼 수 있었다. 또 흥미롭게도 어떤 조건 하에서는 오류가 크더라도 오히려 SVM 의 성능이 향상되는 것을 발견했는데, 이것은 바꾸어 생각하면 Gram matrix 의 일부를 변경하여 SVM 의 성능 향상을 꾀할 수 있음을 나타낸다.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.18 no.3
• /
• pp.297-305
• /
• 2008

Recently, kernel methods have attracted great interests in the areas of pattern classification, function approximation, and anomaly detection. The role of the kernel is particularly important in the methods such as SVM(support vector machine) and KPCA(kernel principal component analysis), for it can generalize the conventional linear machines to be capable of efficiently handling nonlinearities. This paper considers the problem of combining radar and rain gauge observations utilizing the regression approach based on the kernel-based gaussian process and support vector learning. The data-assimilation results of the considered methods are reported for the radar and rain gauge observations collected over the region covering parts of Gangwon, Kyungbuk, and Chungbuk provinces of Korea, along with performance comparison.

• Journal of Biosystems Engineering
• /
• v.15 no.2
• /
• pp.99-109
• /
• 1990

Rough rice is subjected to a series of static and dynamic forces during mechanical harvesting, handling and processing operations. The mechanical properties such as bioyield point, compressive strength, and deformations at the bioyield point and rupture point are important engineering data needed to develop processing machines and to determine reasonable operating conditions for these machines. The objectives of this study were to determine the mechanical properties of the rough rice kernel at loading rate of 0.664 mm/min and 1.673 mm/min and at various moisture contents, and to examine the effect of the moisture content and the loading rate on these mechanical properties. The follwing results were obtained from the study. 1. Bioyield point, rupture point, bioyield strength and ultimate strength of the rough rice kernel generally decreased in magnitude with an increase in moisture content. A little larger values of these mechanical properties were obtained at the higher loading rate. The rough rice variety and the loading rate affected significantly these mechanical properties at low moisture content, but not at the higher moisture levels. 2. Bioyield point of the sample grains varied from 20 to 80 N, and rupture point varied from 45 to 130N. Bioyield point for Japonica-type rough rice was a little higher than that for Indica-type rough rice, but there were little differnces in rupture point between two types of rough rice. 3. Bioyield strength and ultimate strength of the Japonica-type rough rice varied from 10 MPa. to 39 MPa., and from 13 MPa. to 45 MPa. respectively. Those of the Indica-type rough rice varied from 12 MPa. to 42 MPa., and from 15 MPa. to 53 MPa. respectively. 4. Deformations at bioyield point and rupture point ranged from 0.18 mm/min to 0.26 mm, and from 0.28 mm to 0.53 mm respectively. These deformations decreased with an increase in moisture content up to moisture content of approximately 17% (w.b.) and increased again thereafter. 5. Regression equations were developed to predict these mechanical properties for the rough rice kernel as a function of moisture content.