• Title/Summary/Keyword: Radial Basis Function Neural Networks

Search Result 142, Processing Time 0.042 seconds

Genetic Design of Granular-oriented Radial Basis Function Neural Network Based on Information Proximity (정보 유사성 기반 입자화 중심 RBF NN의 진화론적 설계)

  • Park, Ho-Sung;Oh, Sung-Kwun;Kim, Hyun-Ki
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.59 no.2
    • /
    • pp.436-444
    • /
    • 2010
  • In this study, we introduce and discuss a concept of a granular-oriented radial basis function neural networks (GRBF NNs). In contrast to the typical architectures encountered in radial basis function neural networks(RBF NNs), our main objective is to develop a design strategy of GRBF NNs as follows : (a) The architecture of the network is fully reflective of the structure encountered in the training data which are granulated with the aid of clustering techniques. More specifically, the output space is granulated with use of K-Means clustering while the information granules in the multidimensional input space are formed by using a so-called context-based Fuzzy C-Means which takes into account the structure being already formed in the output space, (b) The innovative development facet of the network involves a dynamic reduction of dimensionality of the input space in which the information granules are formed in the subspace of the overall input space which is formed by selecting a suitable subset of input variables so that the this subspace retains the structure of the entire space. As this search is of combinatorial character, we use the technique of genetic optimization to determine the optimal input subspaces. A series of numeric studies exploiting some nonlinear process data and a dataset coming from the machine learning repository provide a detailed insight into the nature of the algorithm and its parameters as well as offer some comparative analysis.

Design of Robust Face Recognition System with Illumination Variation Realized with the Aid of CT Preprocessing Method (CT 전처리 기법을 이용하여 조명변화에 강인한 얼굴인식 시스템 설계)

  • Jin, Yong-Tak;Oh, Sung-Kwun;Kim, Hyun-Ki
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.25 no.1
    • /
    • pp.91-96
    • /
    • 2015
  • In this study, we introduce robust face recognition system with illumination variation realized with the aid of CT preprocessing method. As preprocessing algorithm, Census Transform(CT) algorithm is used to extract locally facial features under unilluminated condition. The dimension reduction of the preprocessed data is carried out by using $(2D)^2$PCA which is the extended type of PCA. Feature data extracted through dimension algorithm is used as the inputs of proposed radial basis function neural networks. The hidden layer of the radial basis function neural networks(RBFNN) is built up by fuzzy c-means(FCM) clustering algorithm and the connection weights of the networks are described as the coefficients of linear polynomial function. The essential design parameters (including the number of inputs and fuzzification coefficient) of the proposed networks are optimized by means of artificial bee colony(ABC) algorithm. This study is experimented with both Yale Face database B and CMU PIE database to evaluate the performance of the proposed system.

Optimization Method of Differential Evolution-based Radial Basis Function Neural Networks (차분 진화 알고리즘 기반 방사형 기저 함수 신경회로망 분류기의 최적화 방법)

  • Ma, Chang-Min;Oh, Sung-Kwun
    • Proceedings of the KIEE Conference
    • /
    • 2011.07a
    • /
    • pp.1962-1963
    • /
    • 2011
  • 본 연구에서는 패턴분류를 위해 최적화된 방사형 기저 함수 신경회로망(Radial Basis Function Neural Networks) 분류기를 제안한다. RBFNN은 입력층, 은닉층, 출력층의 3층 구조로 되어 있으며 Multi Dimension, Predictive ability, Robustness한 특징이 있다. RBFNN의 은닉층에는 기존의 활성함수가 아닌 Fuzzy C-means 클러스터링 알고리즘을 사용하여 입력 데이터의 특성을 고려한 적합도를 사용하였다. RBFNN은 은닉층의 노드수와 FCM 클러스터링의 퍼지화 계수, 연결가중치의 다항식 타입이 모델의 성능의 향상에 영향을 미치기 때문에 최적화가 필요하며 본 논문에서는 Differential Evolution(DE) 알고리즘을 사용하여 모델의 구조 및 파라미터를 최적화시켜 모델의 성능을 향상시켰다. 제안된 모델을 평가하기 위해 패턴분류에 많이 사용되는 Iris 데이터와 Wine 데이터를 이용하였다.

  • PDF

An Identification Technique Based on Adaptive Radial Basis Function Network for an Electronic Odor Sensing System

  • Byun, Hyung-Gi
    • Journal of Sensor Science and Technology
    • /
    • v.20 no.3
    • /
    • pp.151-155
    • /
    • 2011
  • A variety of pattern recognition algorithms including neural networks may be applicable to the identification of odors. In this paper, an identification technique for an electronic odor sensing system applicable to wound state monitoring is presented. The performance of the radial basis function(RBF) network is highly dependent on the choice of centers and widths in basis function. For the fine tuning of centers and widths, those parameters are initialized by an ill-conditioned genetic fuzzy c-means algorithm, and the distribution of input patterns in the very first stage, the stochastic gradient(SG), is adapted. The adaptive RBF network with singular value decomposition(SVD), which provides additional adaptation capabilities to the RBF network, is used to process data from array-based gas sensors for early detection of wound infection in burn patients. The primary results indicate that infected patients can be distinguished from uninfected patients.

The Study of Neural Networks Using Orthogonal function System in Hidden-Layer (직교함수를 은닉층에 지닌 신경회로망에 대한 연구)

  • 권성훈;최용준;이정훈;유석용;엄기환;손동설
    • Proceedings of the IEEK Conference
    • /
    • 1999.06a
    • /
    • pp.482-485
    • /
    • 1999
  • In this paper we proposed a heterogeneous hidden layer consisting of both sigmoid functions and RBFs(Radial Basis Function) in multi-layered neural networks. Focusing on the orthogonal relationship between the sigmoid function and its derivative, a derived RBF that is a derivative of the sigmoid function is used as the RBF in the neural network. so the proposed neural network is called ONN(Orthogonal Neural Network). Identification results using a nonlinear function confirm both the ONN's feasibility and characteristics by comparing with those obtained using a conventional neural network which has sigmoid function or RBF in hidden layer

  • PDF

The Study of Neural Networks Using Orthogonal Function System (직교함수를 사용한 신경회로망에 대한 연구)

  • 권성훈;최용준;이정훈;손동설;엄기환
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 1999.11a
    • /
    • pp.214-217
    • /
    • 1999
  • In this paper we proposed a heterogeneous hidden layer consisting of both sigmoid functions and RBFs(Radial Basis Function) in multi-layered neural networks. Focusing on the orthogonal relationship between the sigmoid function and its derivative, a derived RBF that is a derivative of the sigmoid function is used as the RBF in the neural network. so the proposed neural network is called ONN's feasibility Neural Network). Identification results using a nonlinear. function confirm both the ONN's feasibility and characteristics by comparing with those obtained using a conventional neural network which has sigmoid function or RBF in hidden layer.

  • PDF

VAD By Neural Network Under Wireless Communication Systems (Neural Network을 이용한 무선 통신시스템에서의 VAD)

  • Lee Hosun;Kim Sukyung;Park Sung-Kwon
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.30 no.12C
    • /
    • pp.1262-1267
    • /
    • 2005
  • Elliptical basis function (EBF) neural network works stably under high-level background noise environment and makes the nonlinear processing possible. It can be adapted real time VAD with simple design. This paper introduces VAD implementation using EBF and the experimental results show that EBF VAD outperforms G729 Annex B and RBF neural networks. The best error rates achieved by the EBF networks were improved more than $70\%$ in speech and $50\%$ in silence while that achieved by G.729 Annex B and RBF networks respectively.

Design of Face Recognition System Based on Pose Estimation : Comparative Studies of Pose Estimation Algorithms (포즈 추정 기반 얼굴 인식 시스템 설계 : 포즈 추정 알고리즘 비교 연구)

  • Kim, Jin-Yul;Kim, Jong-Bum;Oh, Sung-Kwun
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.66 no.4
    • /
    • pp.672-681
    • /
    • 2017
  • This paper is concerned with the design methodology of face recognition system based on pose estimation. In 2-dimensional face recognition, the variations of facial pose cause the deterioration of recognition performance because object recognition is carried out by using brightness of each pixel on image. To alleviate such problem, the proposed face recognition system deals with Learning Vector Quantizatioin(LVQ) or K-Nearest Neighbor(K-NN) to estimate facial pose on image and then the images obtained from LVQ or K-NN are used as the inputs of networks such as Convolution Neural Networks(CNNs) and Radial Basis Function Neural Networks(RBFNNs). The effectiveness and efficiency of the post estimation using LVQ and K-NN as well as face recognition rate using CNNs and RBFNNs are discussed through experiments carried out by using ICPR and CMU PIE databases.

Inverse Estimation of Surface Temperature Using the RBF Network (RBF Network 를 이용한 표면온도 역추정에 관한 연구)

  • Jung, Bup-Sung;Lee, Woo-Il
    • Proceedings of the KSME Conference
    • /
    • 2004.04a
    • /
    • pp.1183-1188
    • /
    • 2004
  • The inverse heat conduction problem (IHCP) is a problem of estimating boundary condition from temperature measurement at one or more interior points. Neural networks are general information processing systems inspired by the connectionist theory of human brain. By properly training the network by the learning rule, the neural network method can handle many non-linear or other complex problems. In this work, neural network is applied to complicated inverse heat conduction problems. Efficiency of the procedure is enhanced by incorporating the radial basis functions (RBF). The RBF is trained faster than other neural network and can find smooth solution. In order to demonstrate the effectiveness of the current scheme, a typical one-dimensional IHCP is considered. At one surface, the temperature as well as the heat flux is known. The unknown temperature of interest is estimated on the other side of the slab. The results from the proposed method based on RBF neural network are compared with the conventional method.

  • PDF

A Study on Design of Neural Network for the Prediction of EEG with Chaotic Characteristics (카오스 특성을 갖는 뇌파신호의 예측을 위한 신경회로망 설계에 관한 연구)

  • Shin, Chang-Yong;Kim, Taek-Soo;Park, Sang-Hui
    • Proceedings of the KOSOMBE Conference
    • /
    • v.1995 no.05
    • /
    • pp.265-269
    • /
    • 1995
  • In this study, we present a training method of radial basis function networks based on recursive modified Gram-Schmidt algorithm for single step prediction of chaotic time series. With single step predictions of Mackey-Glass time series and alpha-rhythm EEG which has chaotic characteristics, the radial basis function network trained by this method is compared with one trained by a classical non-recursive method and the radial basis function model proposed by X.D. He and A. Lapedes. The results show the effectiveness of the training method.

  • PDF