• Proceedings of the Korea Inteligent Information System Society Conference
• /
• 1999.10a
• /
• pp.323-335
• /
• 1999

In this paper, we propose a new hybrid model of artificial neural networks(ANNs) and genetic algorithm (GA) to optimal feature transformation and feature weighting. Previous research proposed several variants of hybrid ANNs and GA models including feature weighting, feature subset selection and network structure optimization. Among the vast majority of these studies, however, ANNs did not learn the patterns of data well, because they employed GA for simple use. In this study, we incorporate GA in a simultaneous manner to improve the learning and generalization ability of ANNs. In this study, GA plays role to optimize feature weighting and feature transformation simultaneously. Globally optimized feature weighting overcome the well-known limitations of gradient descent algorithm and globally optimized feature transformation also reduce the dimensionality of the feature space and eliminate irrelevant factors in modeling ANNs. By this procedure, we can improve the performance and enhance the generalisability of ANNs.

• 제어로봇시스템학회:학술대회논문집
• /
• 2004.08a
• /
• pp.1865-1869
• /
• 2004

A new model for the propagation prediction for mobile communication network inside building is presented in this paper. The model is based on the determination of the dominant paths between the transmitter and the receiver. The field strength is predicted with adaptive neuro - fuzzy inference systems (ANFIS), trained with measurements. The advantage of the ANFIS with hybrid least squares and gradient descent algorithms is fast convergence compared with original neural network. The K-means algorithm for selection of training patterns is also used. Comparison of our predicted results to measurements indicate that improvements in accuracy over conventional empirical model are achieved.

• 제어로봇시스템학회:학술대회논문집
• /
• 2003.10a
• /
• pp.2498-2501
• /
• 2003

In this paper, we present a wavelet neural network (WNN) approach to the solution of the path tracking problem for mobile robots that possess complexity, nonlinearity and noise. First, we discuss a WNN based control system where the control signals are directly obtained by minimizing the difference between the reference track and the pose of a mobile robot. This compact network structure is helpful to determine the number of hidden nodes and the initial value of weights. Then, the data with various noises provided by odometric and external sensors are here fused together by means of an Extended Kalman Filter (EKF) approach for the pose estimation problem of mobile robots. This control process is a dynamic on-line process that uses the wavelet neural network trained via the gradient-descent method with estimates from EKF. Finally, we verify the effectiveness and feasibility of the proposed control system through simulations.

• Proceedings of the IEEK Conference
• /
• 2003.07d
• /
• pp.1239-1242
• /
• 2003

The neural networks are a famous model to learn the nonlinear function or nonlinear system. The main point of neural network is that the difference actual output from desired output is used to update weights. Usually, the gradient descent method is used for the learning process. On training process, if learning rate is too large, neural networks hardly guarantee convergence of neural networks. On the other hand, if learning rate is too small, the training spends much time. Therefore, one major problem in use of neural networks are to decrease the teaming time while neural networks are guaranteed convergence. In this paper, we suggest the model of fuzzy logic to neural networks to calibrate learning rate. This method is to tune learning rate dynamically according to error and demonstrates the optimization of training.

• Proceedings of the IEEK Conference
• /
• 1998.10a
• /
• pp.1273-1276
• /
• 1998

The HMM-Net is an architecture for a neural network that implements a hidden Markov model (HMM). The architecture is developed for the purpose of combining the discriminant power of neural networks with the time-domain modeling capability of HMMs. Criteria used for learning HMM-Net classifiers are maximum likelihood (ML), maximum mutual information (MMI), and minimization of mean squared error(MMSE). In this paper we propose an efficient learning method of HMM-Net classifiers using hybrid criteria, ML/MMSE and MMI/MMSE, and report the results of an experimental study comparing the performance of HMM-Net classifiers trained by the gradient descent algorithm with the above criteria. Experimental results for the isolated numeric digits from /0/ to /9/ show that the performance of the proposed method is better than the others in the respects of learning and recognition rates.

• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.33B no.4
• /
• pp.201-208
• /
• 1996

This paper proposes an efficient method for improving the training performance of the neural network using a hybrid of backpropagation algorithm and dynamic tunneling system.The backpropagation algorithm, which is the fast gradient descent method, is applied for high-speed optimization. The dynamic tunneling system, which is the deterministic method iwth a tunneling phenomenone, is applied for blobal optimization. Converging to the local minima by using the backpropagation algorithm, the approximate initial point for escaping the local minima is estimated by the pattern classification, and the simulation results show that the performance of proposed method is superior th that of backpropagation algorithm with randomized initial point settings.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2002.05a
• /
• pp.245-251
• /
• 2002

본 논문에서는 상대적으로 큰 퍼지 엔트로피를 갖는 입력-출력 데이터 집단에 다중 회귀 분석을 적용하여 다차원 평면 클러스터를 생성하고, 이 클러스터를 새로운 퍼지 모델의 규칙으로 추가한 후 퍼지 모델 파라미터의 개략 동조와 정밀 동조를 수행하는 자기구성 퍼지 모델링을 제안한다. Weighted recursive least squared 알고리즘과 fuzzy C-regression model 클러스터링에 의해 퍼지 모델의 파라미터를 개략적으로 동조한 후 gradient descent 알고리즘에 의해 파라미터를 정밀 동조하면서 감수분열 유전 알고리즘을 이용하여 최적의 학습률을 탐색한다. 그리고 자기 구성 퍼지 모델링 기법을 이용하여 Box-Jenkins의 가스로 데이터, 다변수비선형 정적 함수의 데이터와 하수 처리 활성오니 공정의 모델링을 수행하고, 기존의 방법에 의한 모델링 결과와 비교하여 그 성능을 입증한다.

• Proceedings of the Korea Electromagnetic Engineering Society Conference
• /
• 2005.11a
• /
• pp.153-156
• /
• 2005

This paper concerns an efficient iterative approach for eliminating coherent interference signals in linearly constrained adaptive arrays. The Alternate Mainbeam Nulling Algorithm[1] is implemented iteratively to find an optimum weight vector. The convergence parameters in the unit gain and null constraints are calculated using steepest descent method with gradient estimation. The nulling performance of the proposed method is compared with that of conventional ones. It is shown that the proposed method performs better than conventional ones when the power of the coherent signals is large compared with a desired signal. Also, it performs consistently well for more number of interferences.

• Proceedings of the Korean Nuclear Society Conference
• /
• 1996.11a
• /
• pp.85-90
• /
• 1996

In this paper, the self-organizing fuzzy logic controller is developed for water level control of steam generator. In comparison with conventional fuzzy logic controllers, this controller performs control task with no control rules at initial and creates control rules as control behavior goes on, and also modifies its control structure when uncertain disturbance is suspected. Selected parameters in the fuzzy logic controller are updated on-line by the gradient descent loaming algorithm based on the performance cost function. This control algorithm is applied to water level control of steam generator model developed by Lee, et al. The computer simulation results confirm good performance of this control algorithm in all power ranges. This control algorithm can be expected to be used for automatic control of feedwater control system in the nuclear power plant with digital instrumentation and control systems.

• Journal of the Korean Society for Precision Engineering
• /
• v.24 no.12
• /
• pp.57-64
• /
• 2007

There have been many researches for optimal controllers in multivariable systems, and they generally use accurate linear models of the plant dynamics. Real systems, however, contain nonlinearities and high-order dynamics that may be difficult to model using conventional techniques. Therefore, it is necessary a PID gain tuning method without explicit modeling for the multivariable plant dynamics. The PID tuning method utilizes the sign of Jacobian and gradient descent techniques to iteratively reduce the error-related objective function. This paper, especially, focuses on the role of I-controller when there is a steady state error. However, it is not easy to tune I-gain unlike P- and D-gain because I-controller is mainly operated in the steady state. Simulations for an overhead crane system with dynamic friction show that the proposed PID-LC algorithm improves controller performance, even in the steady state error.