• 제목/요약/키워드: Kernel Machines

검색결과 86건 처리시간 0.027초

SVM-Guided Biplot of Observations and Variables

  • Huh, Myung-Hoe
    • Communications for Statistical Applications and Methods
    • /
    • 제20권6호
    • /
    • pp.491-498
    • /
    • 2013
  • We consider support vector machines(SVM) to predict Y with p numerical variables $X_1$, ${\ldots}$, $X_p$. This paper aims to build a biplot of p explanatory variables, in which the first dimension indicates the direction of SVM classification and/or regression fits. We use the geometric scheme of kernel principal component analysis adapted to map n observations on the two-dimensional projection plane of which one axis is determined by a SVM model a priori.

혼합 시퀀스 커널을 이용한 조종사의 비동적 행위 모델링 (A Non-Kinetic Behavior Modeling for Pilots Using a Hybrid Sequence Kernel)

  • 최예림;전승욱;지철규;박종헌;신동민
    • 한국군사과학기술학회지
    • /
    • 제17권6호
    • /
    • pp.773-785
    • /
    • 2014
  • For decades, modeling of pilots has been intensively studied due to its advantages in reducing costs for training and enhancing safety of pilots. In particular, research for modeling of pilots' non-kinetic behaviors which refer to the decisions made by pilots is beneficial as the expertise of pilots can be inherent in the models. With the recent growth in the amount of combat logs accumulated, employing statistical learning methods for the modeling becomes possible. However, the combat logs consist of heterogeneous data that are not only continuous or discrete but also sequence independent or dependent, making it difficult to directly applying the learning methods without modifications. Therefore, in this paper, we present a kernel function named hybrid sequence kernel which addresses the problem by using multiple kernel learning methods. Based on the empirical experiments by using combat logs obtained from a simulator, the proposed kernel showed satisfactory results.

Support Vector Machine을 이용한 부도예측모형의 개발 -격자탐색을 이용한 커널 함수의 최적 모수 값 선정과 기존 부도예측모형과의 성과 비교- (Support Vector Bankruptcy Prediction Model with Optimal Choice of RBF Kernel Parameter Values using Grid Search)

  • 민재형;이영찬
    • 한국경영과학회지
    • /
    • 제30권1호
    • /
    • pp.55-74
    • /
    • 2005
  • Bankruptcy prediction has drawn a lot of research interests in previous literature, and recent studies have shown that machine learning techniques achieved better performance than traditional statistical ones. This paper employs a relatively new machine learning technique, support vector machines (SVMs). to bankruptcy prediction problem in an attempt to suggest a new model with better explanatory power and stability. To serve this purpose, we use grid search technique using 5-fold cross-validation to find out the optimal values of the parameters of kernel function of SVM. In addition, to evaluate the prediction accuracy of SVM. we compare its performance with multiple discriminant analysis (MDA), logistic regression analysis (Logit), and three-layer fully connected back-propagation neural networks (BPNs). The experiment results show that SVM outperforms the other methods.

UFKLDA: An unsupervised feature extraction algorithm for anomaly detection under cloud environment

  • Wang, GuiPing;Yang, JianXi;Li, Ren
    • ETRI Journal
    • /
    • 제41권5호
    • /
    • pp.684-695
    • /
    • 2019
  • In a cloud environment, performance degradation, or even downtime, of virtual machines (VMs) usually appears gradually along with anomalous states of VMs. To better characterize the state of a VM, all possible performance metrics are collected. For such high-dimensional datasets, this article proposes a feature extraction algorithm based on unsupervised fuzzy linear discriminant analysis with kernel (UFKLDA). By introducing the kernel method, UFKLDA can not only effectively deal with non-Gaussian datasets but also implement nonlinear feature extraction. Two sets of experiments were undertaken. In discriminability experiments, this article introduces quantitative criteria to measure discriminability among all classes of samples. The results show that UFKLDA improves discriminability compared with other popular feature extraction algorithms. In detection accuracy experiments, this article computes accuracy measures of an anomaly detection algorithm (i.e., C-SVM) on the original performance metrics and extracted features. The results show that anomaly detection with features extracted by UFKLDA improves the accuracy of detection in terms of sensitivity and specificity.

APPROXIMATE SOLUTIONS TO ONE-DIMENSIONAL BACKWARD HEAT CONDUCTION PROBLEM USING LEAST SQUARES SUPPORT VECTOR MACHINES

  • Wu, Ziku;Li, Fule;Kwak, Do Young
    • 충청수학회지
    • /
    • 제29권4호
    • /
    • pp.631-642
    • /
    • 2016
  • This article deals with one-dimension backward heat conduction problem (BHCP). A new approach based on least squares support vector machines (LS-SVM) is proposed for obtaining their approximate solutions. The approximate solution is presented in closed form by means of LS-SVM, whose parameters are adjusted to minimize an appropriate error function. The approximate solution consists of two parts. The first part is a known function that satisfies initial and boundary conditions. The other is a product of two terms. One term is known function which has zero boundary and initial conditions, another term is unknown which is related to kernel functions. This method has been successfully tested on practical examples and has yielded higher accuracy and stable solutions.

Multi-class SVM을 이용한 회전기계의 결함 진단 (Fault diagnosis of rotating machinery using multi-class support vector machines)

  • 황원우;양보석
    • 한국소음진동공학회:학술대회논문집
    • /
    • 한국소음진동공학회 2003년도 추계학술대회논문집
    • /
    • pp.537-543
    • /
    • 2003
  • Condition monitoring and fault diagnosis of machines are gaining importance in the industry because of the need to increase reliability and to decrease possible loss of production due to machine breakdown. By comparing the vibration signals of a machine running in normal and faulty conditions, detection of faults like mass unbalance, shaft misalignment and bearing defects is possible. This paper presents a novel approach for applying the fault diagnosis of rotating machinery. To detect multiple faults in rotating machinery, a feature selection method and support vector machine (SVM) based multi-class classifier are constructed and used in the faults diagnosis. The results in experiments prove that fault types can be diagnosed by the above method.

  • PDF

The use of support vector machines in semi-supervised classification

  • Bae, Hyunjoo;Kim, Hyungwoo;Shin, Seung Jun
    • Communications for Statistical Applications and Methods
    • /
    • 제29권2호
    • /
    • pp.193-202
    • /
    • 2022
  • Semi-supervised learning has gained significant attention in recent applications. In this article, we provide a selective overview of popular semi-supervised methods and then propose a simple but effective algorithm for semi-supervised classification using support vector machines (SVM), one of the most popular binary classifiers in a machine learning community. The idea is simple as follows. First, we apply the dimension reduction to the unlabeled observations and cluster them to assign labels on the reduced space. SVM is then employed to the combined set of labeled and unlabeled observations to construct a classification rule. The use of SVM enables us to extend it to the nonlinear counterpart via kernel trick. Our numerical experiments under various scenarios demonstrate that the proposed method is promising in semi-supervised classification.

Support Vector Machine의 입력데이터 오류에 대한 Robustness분석 (Robustness Analysis of Support Vector Machines against Errors in Input Data)

  • 이상근;장병탁
    • 한국정보과학회:학술대회논문집
    • /
    • 한국정보과학회 2005년도 한국컴퓨터종합학술대회 논문집 Vol.32 No.1 (B)
    • /
    • pp.715-717
    • /
    • 2005
  • Support vector machine(SVM)은 최근 각광받는 기계학습 방법 중 하나로서, kernel function 이라는 사상(mapping)을 이용하여 입력 공간의 벡터를 classification이 용이한 특징 (feature) 공간의 벡터로 변환하는 것을 근간으로 한다. SVM은 이러한 특징 공간에서 두 클래스를 구분 짓는 hyperplane을 일련의 최적화 방법론을 사용하여 찾아내며, 주어진 문제가 convex problem 인 경우 항상 global optimal solution 을 보장하는 등의 장점을 지닌다. 한편 bioinformatics 연구에서 주로 사용되는 데이터는 측정 오류 등 일련의 오류를 포함하고 있으며, 이러한 오류는 기계학습 방법론이 어떤 decision boundary를 찾아내는가에 영향을 끼치게 된다. 특히 SVM의 경우 이러한 오류는 특징 공간 벡터간의 관계를 나타내는 Gram matrix를 변화로 나타나게 된다. 본 연구에서는 입력 공간에 오류가 발생할 때 그것이 SVM 의 decision boundary를 어떻게 변화시키는가를 대표적인 두 가지 kernel function, 즉 linear kernel과 Gaussian kernel에 대해 분석하였다. Wisconsin대학의 유방암(breast cancer) 데이터에 대해 실험한 결과, 데이터의 오류에 따른 SVM 의 classification 성능 변화 양상을 관찰하여 커널의 종류에 따라 SVM이 어떠한 특성을 보이는가를 밝혀낼 수 있었다. 또 흥미롭게도 어떤 조건 하에서는 오류가 크더라도 오히려 SVM 의 성능이 향상되는 것을 발견했는데, 이것은 바꾸어 생각하면 Gram matrix 의 일부를 변경하여 SVM 의 성능 향상을 꾀할 수 있음을 나타낸다.

  • PDF

가우시안 프로세스 기반 함수근사와 서포트 벡터 학습을 이용한 레이더 및 강우계 관측 데이터의 융합 (Combining Radar and Rain Gauge Observations Utilizing Gaussian-Process-Based Regression and Support Vector Learning)

  • 유철상;박주영
    • 한국지능시스템학회논문지
    • /
    • 제18권3호
    • /
    • pp.297-305
    • /
    • 2008
  • 최근들어, 커널 기법(kernel method)은 패턴 분류, 함수 근사 및 비정상 상태 탐지 등의 분야에서 상당한 관심을 끌고 있다. 특히, 서포트 벡터 머신(support vector machine)이나 커널 주성분 분석(kernel principal component analysis) 등의 방법론에서 커널의 역할은 매우 중요한데, 이는 고전적인 선형 머신이 비선형성을 효과적으로 다룰 수 있도록 일반화 해줄 수 있기 때문이다. 본 논문에서는 커널 기반 가우시안 프로세스(gaussian process) 함수근사 기법과 서포트 벡터 학습을 이용하여 레이더와 강우계의 관측 데이터를 융합하는 문제를 고려한다. 그리고, 국내의 강원, 경북 및 충북에 걸쳐있는 지역에 대한 레이더 자료 및 강우계 자료를 대상으로 하여 본 논문에서 고려하는 방법론들에 의해 데이터 융합을 수행한 결과를 제시하고, 성능비교를 수행한다.

벼의 생물체(生物體) 강복강도(降伏强度) 및 극한강도(極限强度) (Bioyield Strength and Ultimate Strength of Rough Rice)

  • 김만수;김성래;박종민;명병수
    • Journal of Biosystems Engineering
    • /
    • 제15권2호
    • /
    • pp.99-109
    • /
    • 1990
  • Rough rice is subjected to a series of static and dynamic forces during mechanical harvesting, handling and processing operations. The mechanical properties such as bioyield point, compressive strength, and deformations at the bioyield point and rupture point are important engineering data needed to develop processing machines and to determine reasonable operating conditions for these machines. The objectives of this study were to determine the mechanical properties of the rough rice kernel at loading rate of 0.664 mm/min and 1.673 mm/min and at various moisture contents, and to examine the effect of the moisture content and the loading rate on these mechanical properties. The follwing results were obtained from the study. 1. Bioyield point, rupture point, bioyield strength and ultimate strength of the rough rice kernel generally decreased in magnitude with an increase in moisture content. A little larger values of these mechanical properties were obtained at the higher loading rate. The rough rice variety and the loading rate affected significantly these mechanical properties at low moisture content, but not at the higher moisture levels. 2. Bioyield point of the sample grains varied from 20 to 80 N, and rupture point varied from 45 to 130N. Bioyield point for Japonica-type rough rice was a little higher than that for Indica-type rough rice, but there were little differnces in rupture point between two types of rough rice. 3. Bioyield strength and ultimate strength of the Japonica-type rough rice varied from 10 MPa. to 39 MPa., and from 13 MPa. to 45 MPa. respectively. Those of the Indica-type rough rice varied from 12 MPa. to 42 MPa., and from 15 MPa. to 53 MPa. respectively. 4. Deformations at bioyield point and rupture point ranged from 0.18 mm/min to 0.26 mm, and from 0.28 mm to 0.53 mm respectively. These deformations decreased with an increase in moisture content up to moisture content of approximately 17% (w.b.) and increased again thereafter. 5. Regression equations were developed to predict these mechanical properties for the rough rice kernel as a function of moisture content.

  • PDF