• Title/Summary/Keyword: RBF 커널

Search Result 29, Processing Time 0.024 seconds

Structural Design of Radial Basis function Neural Network(RBFNN) Based on PSO (PSO 기반 RBFNN의 구조적 설계)

  • Seok, Jin-Wook;Kim, Young-Hoon;Oh, Sung-Kwun
    • Proceedings of the IEEK Conference
    • /
    • 2009.05a
    • /
    • pp.381-383
    • /
    • 2009
  • 본 논문에서는 대표적인 시스템 모델링 도구중의 하나인 RBF 뉴럴 네트워크(Radial Basis Function Neural Network)를 설계하고 모델을 최적화하기 위하여 최적화 알고리즘인 PSO(Particle Swarm Optimization) 알고리즘을 이용하였다. 즉, 모델의 최적화에 주요한 영향을 미치는 모델의 파라미터들을 PSO 알고리즘을 이용하여 동정한다. 제안된 RBF 뉴럴 네트워크는 은닉층에서의 활성함수로서 일반적으로 많이 사용되어지는 가우시안 커널함수를 사용한다. 더 나아가 모델의 최적화를 위하여 각 커널함수의 중심값은 HCM 클러스터링에 기반을 두어 중심값을 결정하고, PSO 알고리즘을 통하여 가우시안 커널함수의 분포상수, 은닉층에서의 노드 수 그리고 다수의 입력을 가질 경우 입력의 종류를 동정한다. 제안한 모델의 성능을 평가하기 위해 Mackey-Glass 시계열 공정 데이터를 적용하였으며 제안된 모델의 근사화와 일반화 능력을 분석한다.

  • PDF

VRIFA: A Prediction and Nonlinear SVM Visualization Tool using LRBF kernel and Nomogram (VRIFA: LRBF 커널과 Nomogram을 이용한 예측 및 비선형 SVM 시각화도구)

  • Kim, Sung-Chul;Yu, Hwan-Jo
    • Journal of Korea Multimedia Society
    • /
    • v.13 no.5
    • /
    • pp.722-729
    • /
    • 2010
  • Prediction problems are widely used in medical domains. For example, computer aided diagnosis or prognosis is a key component in a CDSS (Clinical Decision Support System). SVMs with nonlinear kernels like RBF kernels, have shown superior accuracy in prediction problems. However, they are not preferred by physicians for medical prediction problems because nonlinear SVMs are difficult to visualize, thus it is hard to provide intuitive interpretation of prediction results to physicians. Nomogram was proposed to visualize SVM classification models. However, it cannot visualize nonlinear SVM models. Localized Radial Basis Function (LRBF) was proposed which shows comparable accuracy as the RBF kernel while the LRBF kernel is easier to interpret since it can be linearly decomposed. This paper presents a new tool named VRIFA, which integrates the nomogram and LRBF kernel to provide users with an interactive visualization of nonlinear SVM models, VRIFA visualizes the internal structure of nonlinear SVM models showing the effect of each feature, the magnitude of the effect, and the change at the prediction output. VRIFA also performs nomogram-based feature selection while training a model in order to remove noise or redundant features and improve the prediction accuracy. The area under the ROC curve (AUC) can be used to evaluate the prediction result when the data set is highly imbalanced. The tool can be used by biomedical researchers for computer-aided diagnosis and risk factor analysis for diseases.

Support Vector Machine Classification of Hyperspectral Image using Spectral Similarity Kernel (분광 유사도 커널을 이용한 하이퍼스펙트럴 영상의 Support Vector Machine(SVM) 분류)

  • Choi, Jae-Wan;Byun, Young-Gi;Kim, Yong-Il;Yu, Ki-Yun
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.14 no.4 s.38
    • /
    • pp.71-77
    • /
    • 2006
  • Support Vector Machine (SVM) which has roots in a statistical learning theory is a training algorithm based on structural risk minimization. Generally, SVM algorithm uses the kernel for determining a linearly non-separable boundary and classifying the data. But, classical kernels can not apply to effectively the hyperspectral image classification because it measures similarity using vector's dot-product or euclidian distance. So, This paper proposes the spectral similarity kernel to solve this problem. The spectral similariy kernel that calculate both vector's euclidian and angle distance is a local kernel, it can effectively consider a reflectance property of hyperspectral image. For validating our algorithm, SVM which used polynomial kernel, RBF kernel and proposed kernel was applied to land cover classification in Hyperion image. It appears that SVM classifier using spectral similarity kernel has the most outstanding result in qualitative and spatial estimation.

  • PDF

A Comparative Study on Suitable SVM Kernel Function of Land Cover Classification Using KOMPSAT-2 Imagery (KOMPSAT-2 영상의 토지피복분류에 적합한 SVM 커널 함수 비교 연구)

  • Kang, Nam Yi;Go, Sin Young;Cho, Gi Sung
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.21 no.2
    • /
    • pp.19-25
    • /
    • 2013
  • Recently, the high-resolution satellite images is used the land cover and status data for the natural resources or environment management very helpful. The SVM algorithm of image processing has been used in various field. However, classification accuracy by SVM algorithm can be changed by various kernel functions and parameters. In this paper, the typical kernel function of the SVM algorithm was applied to the KOMPSAT-2 image and than the result of land cover performed the accuracy analysis using the checkpoint. Also, we carried out the analysis for selected the SVM kernel function from the land cover of the target region. As a result, the polynomial kernel function is demonstrated about the highest overall accuracy of classification. And that we know that the polynomial kernel and RBF kernel function is the best kernel function about each classification category accuracy.

A Study on SVM-Based Speaker Classification Using GMM-supervector (GMM-supervector를 사용한 SVM 기반 화자분류에 대한 연구)

  • Lee, Kyong-Rok
    • Journal of IKEEE
    • /
    • v.24 no.4
    • /
    • pp.1022-1027
    • /
    • 2020
  • In this paper, SVM-based speaker classification is experimented with GMM-supervector. To create a speaker cluster, conventional speaker change detection is performed with the KL distance using the SNR-based weighting function. SVM-based speaker classification consists of two steps. In the first step, SVM-based classification between UBM and speaker models is performed, speaker information is indexed in each cluster, and then grouped by speaker. In the second step, the SVM-based classification between UBM and speaker models is performed by inputting the speaker cluster group. Linear and RBF are applied as kernel functions for SVM-based classification. As a result, in the first step, the case of applying the linear kernel showed better performance than RBF with 148 speaker clusters, MDR 0, FAR 47.3, and ER 50.7. The second step experiment result also showed the best performance with 109 speaker clusters, MDR 1.3, FAR 28.4, and ER 32.1 when the linear kernel was applied.

Design of RBF-based Polynomial Neural Network And Optimization (방사형 기저 함수 기반 다항식 뉴럴네트워크 설계 및 최적화)

  • Kim, Ki-Sang;Jin, Yong-Ha;Oh, Sung-Kwun
    • Proceedings of the KIEE Conference
    • /
    • 2009.07a
    • /
    • pp.1863_1864
    • /
    • 2009
  • 본 연구에서는 복잡한 비선형 모델링 방법인 RBF 뉴럴 네트워크(Radial Basis Function Neural Network)와 PNN(Polynomial Neural Network)을 접목한 새로운 형태의 Radial Basis Function Polynomial Neural Network(RPNN)를 제안한다. RBF 뉴럴 네트워크는 빠른 학습 시간, 일반화 그리고 단순화의 특징으로 비선형 시스템 모델링 등에 적용되고 있으며, PNN은 생성된 노드들 중에서 우수한 결과값을 가진 노드들을 선택함으로써 모델의 근사화 및 일반화에 탁월한 효과를 가진 비선형 모델링 방법이다. 제안된 RPNN모델의 기본적인 구조는 PNN의 형태를 이루고 있으며, 각각의 노드는 RBF 뉴럴 네트워크로 구성하였다. 사용된 RBF 뉴럴 네트워크에서의 커널 함수로는 FCM 클러스터링을 사용하였으며, 각 노드의 후반부는 다항식 구조로 표현하였다. 또한 입력개수, 입력변수, 클러스터의 개수를 PSO알고리즘(Particle Swarm Optimization)을 사용하여 최적화 시켰다. 제안한 모델의 적용 및 유용성을 비교 평가하기 위하여 비선형 데이터를 이용하여 그 우수성을 보인다.

  • PDF

Design of RBF-based Polynomial Neural Network (방사형 기저 함수 기반 다항식 뉴럴네트워크 설계)

  • Kim, Ki-Sang;Jin, Yong-Ha;Oh, Sung-Kwun;Kim, Hyun-Ki
    • Proceedings of the IEEK Conference
    • /
    • 2009.05a
    • /
    • pp.261-263
    • /
    • 2009
  • 본 연구에서는 복잡한 비선형 모델링 방법인 RBF 뉴럴 네트워크(Radial Basis Function Neural Network)와 PNN(Polynomial Neural Network)을 접목한 새로운 형태의 Radial Basis Function Polynomial Neural Network(RPNN)를 제안한다. RBF 뉴럴 네트워크는 빠른 학습 시간, 일반화 그리고 단순화의 특징으로 비선형 시스템 모델링 등에 적용되고 있으며, PNN은 생성된 노드들 중에서 우수한 결과값을 가진 노드들을 선택함으로써 모델의 근사화 및 일반화에 탁월한 효과를 가진 비선형 모델링 방법이다. 제안된 RPNN모델의 기본적인 구조는 PNN의 형태를 이루고 있으며, 각각의 노드는 RBF 뉴럴 네트워크로 구성하였다. 사용된 RBF 뉴럴 네트워크에서의 커널 함수로는 FCM 클러스터링을 사용하였으며, 각 노드의 후반부는 다항식 구조로 표현하였다. 또한 각 노드의 후반부 파라미터들은 최소자승법을 이용하여 최적화 하였다. 제안한 모델의 적용 및 유용성을 비교 평가하기 위하여 비선형 데이터를 이용하여 그 우수성을 보인다.

  • PDF

Mechanical Fault Classification of an Induction Motor using Texture Analysis (질감 분석을 이용한 유도 전동기의 기계적 결함 분류)

  • Jang, Won-Chul;Park, Yong-Hoon;Kang, Myeong-Su;Kim, Jong-Myon
    • Journal of the Korea Society of Computer and Information
    • /
    • v.18 no.12
    • /
    • pp.11-19
    • /
    • 2013
  • This paper proposes an algorithm using vibration signals and texture analysis for mechanical fault diagnosis of an induction motor. We analyze characteristics of contrast and pattern of an image converted from vibration signal and extract three texture features using gray-level co-occurrence model(GLCM). Then, the extracted features are used as inputs of a multi-level support vector machine(MLSVM) which utilizes the radial basis function(RBF) kernel function to classify each fault type. In addition, we evaluate the classification performance with varying the parameter from 0.3 to 1.0 for the RBF kernel function of MLSVM, and the proposed algorithm achieved 100% classification accuracy with the parameter of the RBF from 0.3 to 1.0. Moreover, the proposed algorithm achieved about 98% classification accuracy with 15dB and 20dB noise inserted vibration signals.

Indoor Environment Recognition of Mobile Robot Using SVR (SVR을 이용한 이동로봇의 실내환경 인식)

  • Shim, Jun-Hong;Choi, Jeong-Won
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.24 no.8
    • /
    • pp.119-125
    • /
    • 2010
  • This paper proposes a new solution about physical problem of autonomous mobile robots system using ultrasonic sensors. An mobile robot uses several sensors for recognition of its circumstance. However, such sensor data are not accurate all the time. A means of removing the noise that sensor data contains constantly, It is possible for simulation to estimate its circumstance based on ultrasonic sensor data by learning algorithm SVR(Support Vector Regression). To use SVR, it is being selected parameter and kernel which are the component of SVR. Selecting the component of SVR, the most accurate parameter data was selected through the tests because it is not existed determined data. In addition, choosing the kernel uses RBF(Radial Basis Function) kernel which is the most generalized. This paper proposes SVR based algorithm to compensate for the above demerits of ultrasonic sensor through the experimentation under three different environments.

Robust determination of control parameters in K chart with respect to data structures (데이터 구조에 강건한 K 관리도의 관리 모수 결정)

  • Park, Ingkeun;Lee, Sungim
    • Journal of the Korean Data and Information Science Society
    • /
    • v.26 no.6
    • /
    • pp.1353-1366
    • /
    • 2015
  • These days Shewhart control chart for evaluating stability of the process is widely used in various field. But it must follow strict assumption of distribution. In real-life problems, this assumption is often violated when many quality characteristics follow non-normal distribution. Moreover, it is more serious in multivariate quality characteristics. To overcome this problem, many researchers have studied the non-parametric control charts. Recently, SVDD (Support Vector Data Description) control chart based on RBF (Radial Basis Function) Kernel, which is called K-chart, determines description of data region on in-control process and is used in various field. But it is important to select kernel parameter or etc. in order to apply the K-chart and they must be predetermined. For this, many researchers use grid search for optimizing parameters. But it has some problems such as selecting search range, calculating cost and time, etc. In this paper, we research the efficiency of selecting parameter regions as data structure vary via simulation study and propose a new method for determining parameters so that it can be easily used and discuss a robust choice of parameters for various data structures. In addition, we apply it on the real example and evaluate its performance.