• Journal of the Institute of Convergence Signal Processing
• /
• v.3 no.1
• /
• pp.48-53
• /
• 2002

In this paper, we presented a new approach to the recognition of unconstrained handwritten numerals using an improved RBF(Radial Basis Function) Neural Networks. The RBF Neural Networks used Raised Cosine as a basis function to improve discrimination and reduce processing time. The performance of Raised Cosine RBF Neural Networks classifier was evaluated using totally unconstrained handwritten numeral database of Concordia University, Montreal, Canada, and the experimental results showed the recognition rate of 98.05%.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.65 no.6
• /
• pp.1070-1079
• /
• 2016

In this paper, the design of recursive radial basis function neural networks based on incremental fuzzy c-means is introduced for processing the big data. Radial basis function neural networks consist of condition, conclusion and inference phase. Gaussian function is generally used as the activation function of the condition phase, but in this study, incremental fuzzy clustering is considered for the activation function of radial basis function neural networks, which could effectively do big data processing. In the conclusion phase, the connection weights of networks are given as the linear function. And then the connection weights are calculated by recursive least square estimation. In the inference phase, a final output is obtained by fuzzy inference method. Machine Learning datasets are employed to demonstrate the superiority of the proposed classifier, and their results are described from the viewpoint of the algorithm complexity and performance index.

• Proceedings of the IEEK Conference
• /
• 2009.05a
• /
• pp.387-389
• /
• 2009

본 논문에서는 다항식 기반 Radial Basis Function(RBF)신경 회로망을 설계하고 이를 패턴분류 문제에 적용하여 그 성능을 분석한다. 제안된 RBF 신경회로망은 입력층, 은닉층, 출력층으로 이루어진다. 입력층의 연결가중치는 1로서 입력층의 입력벡터는 그대로 은닉층으로 전달되고 은닉층은 FCM(Fuzzy C-means Clustering)방법을 통하여 뉴런의 출력 값으로 내보낸다. 은닉층과 출력층사이의 연결가중치는 상수, 선형식 또는 이차식으로 이루어지며 경사 하강법에 의해 학습되어진다. 네트워크의 최종 출력은 연결가중치와 은닉층 출력의 곱에 의한 퍼지추론의 결과로 얻어진다. 제안된 RBF 신경회로망은 여러 종류의 machine learning 데이터에 적용하여 패턴분류기로서의 성능을 평가받는다.

• Proceedings of the IEEK Conference
• /
• 2002.07a
• /
• pp.30-33
• /
• 2002

To obtain good performance of radial basis function (RBF) neural networks, it needs very careful consideration in design. The selection of several parameters such as the number of centers and widths of the radial basis functions must be considered carefully since they critically affect the network's performance. We propose a learning algorithm for growing of complexity of RBF neural networks which is adapted automatically according to the complexity of tasks. The algorithm generates a new basis function based on the errors of network, the percentage of decreasing rate of errors and the nearest distance from input data to the center of hidden unit. The RBF's center is located at the point where the maximum of absolute interference error occurs in the input space. The width is calculated based on the standard deviation of distance between the center and inputs data. The steepest descent method is also applied for adjusting the weights, centers, and widths. To demonstrate the performance of the proposed algorithm, general problem of function estimation is evaluated. The results obtained from the simulation show that the proposed algorithm for RBF neural networks yields good performance in terms of convergence and accuracy compared with those obtained by conventional multilayer feedforward networks.

• Proceedings of the IEEK Conference
• /
• 2002.07a
• /
• pp.26-29
• /
• 2002

Radial Basis Function (RBF) networks is known as efficient method in classification problems and function approximation. The basis function of RBF networks is usual adopted normal distribution like the Gaussian function. The output of the Gaussian function has the maximum at the center and decrease as increase the distance from the center. For learning of neural network, the method treating the limited area of input space is sometimes more useful than the method treating the whole of input space. The q-normal distribution is the set of probability density function include the Gaussian function. In this paper, we introduce the RBF networks with the basis function of q-normal distribution and actually approximate a function using the RBF networks.

• Proceedings of the KIEE Conference
• /
• 2007.10a
• /
• pp.451-452
• /
• 2007

본 논문에서는 다항식 기반 Radial Basis Function(RBF)신경회로망(Polynomial based Radial Basis Function Neural Networks)을 설계하고 이를 2-클래스 패턴 분류 문제에 응용하여 그 성능을 분석한다. 제안된 다항식기반 RBF 신경회로망은 입력층, 은닉층, 출력 층으로 이루어진다. 입력층은 입력 벡터의 값들을 은닉 층으로 전달하는 기능을 수행하고 은닉층은 Fuzzy c-means 클러스터링을 통하여 뉴런의 출력 값으로 내보낸다. 은닉층과 출력층사이의 연결가중치는 상수, 선형식 또는 이차식으로 이루어지며 경사 하강법에 의해 학습된다. Networks의 최종 출력은 연결가중치와 은닉층 출력의 곱에 의해 퍼지추론의 결과로서 얻어진다. 제안된 다항식기반 RBF 신경회로망은 각기 다른 4종류의 2-클래스 분류 문제에 적용 및 평가되어 분류기로써의 성능을 분석한다.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.60 no.3
• /
• pp.639-647
• /
• 2011

In this paper, we introduce a design methodology of data-centroid Radial Basis Function neural networks with extended polynomial function. The two underlying design mechanisms of such networks involve K-means clustering method and Particle Swarm Optimization(PSO). The proposed algorithm is based on K-means clustering method for efficient processing of data and the optimization of model was carried out using PSO. In this paper, as the connection weight of RBF neural networks, we are able to use four types of polynomials such as simplified, linear, quadratic, and modified quadratic. Using K-means clustering, the center values of Gaussian function as activation function are selected. And the PSO-based RBF neural networks results in a structurally optimized structure and comes with a higher level of flexibility than the one encountered in the conventional RBF neural networks. The PSO-based design procedure being applied at each node of RBF neural networks leads to the selection of preferred parameters with specific local characteristics (such as the number of input variables, a specific set of input variables, and the distribution constant value in activation function) available within the RBF neural networks. To evaluate the performance of the proposed data-centroid RBF neural network with extended polynomial function, the model is experimented with using the nonlinear process data(2-Dimensional synthetic data and Mackey-Glass time series process data) and the Machine Learning dataset(NOx emission process data in gas turbine plant, Automobile Miles per Gallon(MPG) data, and Boston housing data). For the characteristic analysis of the given entire dataset with non-linearity as well as the efficient construction and evaluation of the dynamic network model, the partition of the given entire dataset distinguishes between two cases of Division I(training dataset and testing dataset) and Division II(training dataset, validation dataset, and testing dataset). A comparative analysis shows that the proposed RBF neural networks produces model with higher accuracy as well as more superb predictive capability than other intelligent models presented previously.

• Proceedings of the KIEE Conference
• /
• 2003.11c
• /
• pp.657-660
• /
• 2003

Control of multi-link robot arms is a very difficult problem because of the highly nonlinear dynamics. Decentralized control scheme is developed for control of robot manipulators based on RBF(Radial Basis Function) Neural Networks. RBF Neural Networks is used to approximate the coupling forces among the joints, coriolis force, centrifugal force, gravitational force, and frictional force. The compensation controller is also proposed to estimate the bound of approximation error so that the chattering effect of the control effort can be reduced. The proposed scheme does not require an accurate manipulator dynamic, and it is proved that closed-loop system is asymptotic stable despite the gross robot parameter variations. Numerical simulations for two-link robot manipulator are included to show the effectiveness of controller.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.58 no.6
• /
• pp.1223-1229
• /
• 2009

The performance of Radial Basis Function Neural Networks depends on setting up the Radial Basis Functions over the input space which are the important design procedure of Radial Basis Function Neural Networks. The existing method to initialize the location of the radial basis functions over the input space is to use the conditional fuzzy C-means clustering. However, the researchers which are interested in the conditional fuzzy C-means clustering cannot get as good modeling performance as they expect because the conditional fuzzy C-means clustering cannot project the information which is extracted over the output space into the input space. To compensate the above mentioned drawback of the conditional fuzzy C-means clustering, we apply a fuzzy K-nearest neighbors approach to project the auxiliary information defined over the output space into the input space without lose of the information.

• Journal of Korea Water Resources Association
• /
• v.34 no.4
• /
• pp.303-316
• /
• 2001

In this study, Radial Basis Function(RBF) Neural Networks Model, a kind of Hybrid Neural Networks was applied to hydrological forecasting in a small watershed. RBF Neural Networks Model has four kinds of parameters in it and consists of unsupervised and supervised training patterns. And Gaussian Kernel Function(GKF) was used among many kinds of Radial Basis Functions(RBFs). K-Means clustering algorithm was applied to optimize centers and widths which ate the parameters of GKF. The parameters of RBF Neural Networks Model such as centers, widths weights and biases were determined by the training procedures of RBF Neural Networks Model. And, with these parameters the validation procedures of RBF Neural Networks Model were carried out. RBF Neural Networks Model was applied to Wi-Stream basin which is one of the IHP Representative basins in South Korea. 10 rainfall events were selected for training and validation of RBF Neural Networks Model. The results of RBF Neural Networks Model were compared with those of Elman Neural Networks(ENN) Model. ENN Model is composed of One Step Secant BackPropagation(OSSBP) and Resilient BackPropagation(RBP) algorithms. RBF Neural Networks shows better results than ENN Model. RBF Neural Networks Model spent less time for the training of model and can be easily used by the hydrologists with little background knowledge of RBF Neural Networks Model.