• Proceedings of the KIEE Conference
• /
• 2008.10b
• /
• pp.247-248
• /
• 2008

본 논문에서는 TYPE-2 퍼지 추론 기반의 RBF 뉴럴 네트워크(TYPE-2 Radial Basis Function Neural Network, T2RBFNN)를 설계하고 PSO(Particle Swarm Optimization) 알고리즘을 이용하여 모델의 파라미터를 동정한다. 제안된 모델의 은닉층은 TYPE-2 가우시안 활성 함수로 구성되며, 출력층은 Interval set 형태의 연결가중치를 갖는다. 여기에서 규칙 전반부 활성함수의 중심 선택은 C-means 클러스터링 알고리즘을 이용하고, 규칙 후반부 Interval set 형태의 연결가중치 결정에는 경사 하강법(Gradient descent method)을 이용한 오류 역전파 알고리즘을 사용하여 학습한다. 또한, 최적의 모델을 설계하기 위한 학습율 및 활성함수의 활성화 영역 결정에는 입자 군집 최적화(PSO; Particle Swarm Optimization) 알고리즘으로 동조한다. 마지막으로, 제안된 모델의 평가를 위하여 모의 데이터 집합(Synthetic dadaset)을 적용하고 근사화 및 일반화 능력에 대하여 토의한다.

• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.31B no.4
• /
• pp.145-154
• /
• 1994

This paper proposes an efficient method for improving the training performance of the neural network by using a hybrid of a stochastic approximation and a backpropagation algorithm. The proposed method improves the performance of the training by appliying a global optimization method which is a hybrid of a stochastic approximation and a backpropagation algorithm. The approximate initial point for a stochastic approximation and a backpropagation algorihtm. The approximate initial point for fast global optimization is estimated first by applying the stochastic approximation, and then the backpropagation algorithm, which is the fast gradient descent method, is applied for a high speed global optimization. And further speed-up of training is made possible by adjusting the training parameters of each of the output and the hidden layer adaptively to the standard deviation of the neuron output of each layer. The proposed method has been applied to the parity checking and the pattern classification, and the simulation results show that the performance of the proposed method is superior to that of the backpropagation, the Baba's MROM, and the Sun's method with randomized initial point settings. The results of adaptive adjusting of the training parameters show that the proposed method further improves the convergence speed about 20% in training.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.18 no.6
• /
• pp.842-848
• /
• 2008

This paper deal with uncertainty problem by using Type-2 fuzzy logic set for nonlinear system modeling. We design Type-2 fuzzy logic system in which the antecedent and the consequent part of rules are given as Type-2 fuzzy set and also analyze the performance of the ensuing nonlinear model with uncertainty. Here, the apexes of the antecedent membership functions of rules are decided by C-means clustering algorithm and the apexes of the consequent membership functions of rules are learned by using back-propagation based on gradient decent method. Also, the parameters related to the fuzzy model are optimized by means of particle swarm optimization. The proposed model is demonstrated with the aid of two representative numerical examples, such as mathematical synthetic data set and Mackey-Glass time series data set and also we discuss the approximation as well as generalization abilities for the model.

• Proceedings of the IEEK Conference
• /
• 2003.07d
• /
• pp.1239-1242
• /
• 2003

The neural networks are a famous model to learn the nonlinear function or nonlinear system. The main point of neural network is that the difference actual output from desired output is used to update weights. Usually, the gradient descent method is used for the learning process. On training process, if learning rate is too large, neural networks hardly guarantee convergence of neural networks. On the other hand, if learning rate is too small, the training spends much time. Therefore, one major problem in use of neural networks are to decrease the teaming time while neural networks are guaranteed convergence. In this paper, we suggest the model of fuzzy logic to neural networks to calibrate learning rate. This method is to tune learning rate dynamically according to error and demonstrates the optimization of training.

• Journal of Mechanical Science and Technology
• /
• v.16 no.4
• /
• pp.454-467
• /
• 2002

It has been established that a crack has an important effect on the dynamic behavior of a structure. This effect depends mainly on the location and depth of the crack. Toidentifythelocation and depth of a crack in a structure, a method is presented in this paper which uses neuro-fuzzy-evolutionary technique, that is, Adaptive-Network-based Fuzzy Inference System (ANFIS) solved via hybrid learning algorithm (the back-propagation gradient descent and the least-squares method) and Continuous Evolutionary Algorithms (CEAs) solving sir ale objective optimization problems with a continuous function and continuous search space efficiently are unified. With this ANFIS and CEAs, it is possible to formulate the inverse problem. ANFIS is used to obtain the input(the location and depth of a crack) - output(the structural Eigenfrequencies) relation of the structural system. CEAs are used to identify the crack location and depth by minimizing the difference from the measured frequencies. We have tried this new idea on beam structures and the results are promising.

• Proceedings of the KIEE Conference
• /
• 1998.11b
• /
• pp.537-539
• /
• 1998

In this paper, we construct the on-line model structure for the nonlinear process systems using the adaptive fuzzy-neural network. Adaptive fuzzy-neural network usually consists of two distinct modifiable structure, with both, the premise and the consequent part. These two parts can be adapted by different optimization methods, which are the hybrid learning procedure combining gradient descent method and least square method. To achieve the on-line model structure, we use the recursive least square method for the consequent parameter identification of nonlinear process. We design the interface between PLC and main computer, and construct the monitoring and control simulator for the nonlinear process. The proposed on-line modeling to real process is carried out to obtain the effective and accurate results.

• Proceedings of the KIEE Conference
• /
• 2003.07d
• /
• pp.2414-2416
• /
• 2003

In this raper, we present a Wavelet Neural Network(WNN) approach to the solution of the tracking problem for mobile robots that possess complexity, nonlinearity and uncertainty. The neural network is constructed by the wavelet orthogonal decomposition to form a wavelet neural network that can overcome the problems caused by local minima of optimization and various uncertainties. This network structure is helpful to determine the number of the hidden nodes and the initial value of weights with compact structure. In our control method, the control signals are directly obtained by minimizing the difference between the reference track and the pose of a mobile robot that is controlled through a wavelet neural network. The control process is a dynamic on-line process that uses the wavelet neural network trained by the gradient-descent method. Through computer simulations, we demonstrate the effectiveness and feasibility of the proposed control method.

• Proceedings of the KIEE Conference
• /
• 2007.07a
• /
• pp.576-577
• /
• 2007

본 논문은 전력시스템 수용가를 구성하는 비선형 부하에 흐르는 왜곡된 파형을 가진 전류의 상대적 비율을 결정하여 비선형 전기부하구성을 예측하기 위한 연구이다. 본 논문에서는 수용가 전기부하 구성 예측을 위한 해결 절차로써 수용가의 수리적 모델링을 통한 시스템 방정식을 도출하였고 최적화 이론을 적용하였다. 또한, 본 시스템에 적용한 최적화 알고리즘으로 steepest descent, conjugate gradient, Broydon-Fletcher-Goldfarb-Shanno (BFGS) 기법을 사용하였고, 예측된 결과들의 성능을 나타내는 지표인 수렴 속도와 정확도 비교를 통하여 분산 전력시스템의 전기부하구성 예측을 위해 BFGS 기법을 적용하는 것이 가장 효율적인 방안임을 보였다.

• Journal of Power System Engineering
• /
• v.6 no.1
• /
• pp.96-101
• /
• 2002

In this paper, we address the problem of controlling an end-effector to track and grab a moving target using the visual servoing technique. A visual servo mechanism based on the image-based servoing principle, is proposed by using visual feedback to control an end-effector without calibrated robot and camera models. Firstly, we consider the control problem as a nonlinear least squares optimization and update the joint angles through the Taylor Series Expansion. And to track a moving target in real time, the Jacobian estimation scheme(Dynamic Broyden's Method) is used to estimate the combined robot and image Jacobian. Using this algorithm, we can drive the objective function value to a neighborhood of zero. To show the effectiveness of the proposed algorithm, simulation results for a six degree of freedom robot are presented.

• Proceedings of the Korean Information Science Society Conference
• /
• 2004.04b
• /
• pp.721-723
• /
• 2004

A trust-region method is a quite attractive optimization technique. It is, in general, faster than the steepest descent method and is free of a learning rate unlike the gradient-based methods. In addition to its convergence property (between linear and quadratic convergence), ifs stability is always guaranteed, in contrast to the Newton's method. In this paper, we present an efficient implementation of the maximum likelihood independent component analysis (ICA) using the trust-region method, which leads to trust-region-based ICA (TR-ICA) algorithms. The useful behavior of our TR-ICA algorithms is confimed through numerical experimental results.