• Journal of information and communication convergence engineering
• /
• v.1 no.3
• /
• pp.104-108
• /
• 2003

A biologically inspired fuzzy multilayer perceptron is proposed in this paper. The proposed algorithm is established under consideration of biological neuronal structure as well as fuzzy logic operation. We applied this suggested learning algorithm to benchmark problem in neural network such as exclusive OR and 3-bit parity, and to digit image recognition problems. For the comparison between the existing and proposed neural networks, the convergence speed is measured. The result of our simulation indicates that the convergence speed of the proposed learning algorithm is much faster than that of conventional backpropagation algorithm. Furthermore, in the image recognition task, the recognition rate of our learning algorithm is higher than of conventional backpropagation algorithm.

• Proceedings of the IEEK Conference
• /
• 1998.10a
• /
• pp.1281-1284
• /
• 1998

This paper proposes an efficient time series prediction of the nonlinear dynamical discrete-time systems using multilayer neural networks of a hybrid learning algorithm. The proposed learning algorithm is a hybrid backpropagation algorithm based on the steepest descent for high-speed optimization and the dynamic tunneling for global optimization. The proposed algorithm has been applied to the y00 samples of 700 sequences to predict the next 100 samples. The simulation results shows that the proposed algorithm has better performances of the convergence and the prediction, in comparision with that using backpropagation algorithm based on the gradient descent for multilayer neural network.

• Journal of the Institute of Electronics Engineers of Korea TE
• /
• v.39 no.4
• /
• pp.363-369
• /
• 2002

In this paper, it could improved on the arbitrary nonlinear function learning approximation which have the wavelet neural network based on Adaptive Neuro-Fuzzy Inference System(ANFIS) and the multi-resolution Analysis(MRA) of the wavelet transform. ANFIS structure is composed of a bell type fuzzy membership function, and the wavelet neural network structure become composed of the forward algorithm and the backpropagation neural network algorithm. This wavelet composition has a single size, and it is used the backpropagation algorithm for learning of the wavelet neural network based on ANFIS. It is confirmed to be improved the wavelet base number decrease and the convergence speed performances of the wavelet neural network based on ANFIS Model which is using the wavelet translation parameter learning and bell type membership function of ANFIS than the conventional algorithm from 1 dimension and 2 dimension functions.

• Journal of Welding and Joining
• /
• v.21 no.1
• /
• pp.80-86
• /
• 2003

This study develops a system for effective prediction of residual stresses by the backpropagation algorithm using the neural network. To achieve this goal, a series of experiments were carried out to and measured the residual stresses using the sectional method. With the experimental results, the optional control algorithms using a neural network could be developed in order to reduce the effect of the external disturbances during GMA welding processes. Then the results obtained from this study were compared between the measured and calculated results, weld guality might be controlled by the neural network based on backpropagation algorithm.. This system can not only help to understand the interaction between the process parameters and residual stress, but also improve the quantity control for welded structures.

• Proceedings of the Korean Society of Machine Tool Engineers Conference
• /
• 2000.04a
• /
• pp.484-490
• /
• 2000

The abjective of the study is the development of the system for effective prediction of residual stresses using the backpropagation algorithm from the neural network. To achieve this goal, the series experiment were carried out and measured the residual stresses using the sectional method. Using the experimental results, the optional control algorithms using a neural network should be developed in order to reduce the effect of the external disturbances on during GMA welding processes. Then the results obtained from this study were compared between the measured and calculated results, the neural network based on backpropagation algorithm might be controlled weld quality. This system can not only help to understand the interaction between the process parameters and residual stress, but also improve the quantity control for welded structures.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.16 no.1
• /
• pp.35-45
• /
• 1991

Multi layer neural network using backpropagation learning algorithm is used to achieve identification and orientation estimation of different classes of aircraft in the variety of 3-D orientations. In-plane distortion invarient$(L,\;{\Phi})$ feature was extracted from each aircraft image to be used for training neural network aircraft classifier. For aircraft identification the optimum structure of the neural network classifier is studied to obtain high classification performance. Effective reductioin of learning time was achieved by using modified backpropagation learning algorithm and varying, learning parameters.

• Proceedings of the KIEE Conference
• /
• 2004.11c
• /
• pp.349-351
• /
• 2004

The classical dynamic backpropagation learning algorithm has the problems of learning speed and the determine of learning parameter. The Extend Kalman Filter(EKF) is used effectively for a state estimation method for a non linear dynamic system. This paper presents a learning algorithm using Dual Extended Kalman Filter(DEKF) for Fully Recurrent Neural Network(FRNN). This DEKF learning algorithm gives the minimum variance estimate of the weights and the hidden outputs. The proposed DEKF learning algorithm is applied to the system identification of a nonlinear SISO system and compared with dynamic backpropagation learning algorithm.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.28 no.10C
• /
• pp.1007-1012
• /
• 2003

In order to accelerate the convergence speed of the conventional BP algorithm, constrained optimization techniques are applied to the BP algorithm. First, the noise-constrained least mean square algorithm and the zero noise-constrained LMS algorithm are applied (designated the NCBP and ZNCBP algorithms, respectively). These methods involve an important assumption: the filter or the receiver in the NCBP algorithm must know the noise variance. By means of extension and generalization of these algorithms, the authors derive an adaptive error-constrained BP algorithm, in which the error variance is estimated. This is achieved by modifying the error function of the conventional BP algorithm using Lagrangian multipliers. The convergence speeds of the proposed algorithms are 20 to 30 times faster than those of the conventional BP algorithm, and are faster than or almost the same as that achieved with a conventional linear adaptive filter using an LMS algorithm.

• Proceedings of the Computational Structural Engineering Institute Conference
• /
• 1998.04a
• /
• pp.216-225
• /
• 1998

Although artificial neural network based on backpropagation algorithm is an excellent system simulator, it has still unsolved problems of its structure-decision and learning method. That is, we cannot find a general approach to decide the structure of the neural network and cannot train it satisfactorily because of the local optimum point which it frequently falls into. In addition, although there are many successful applications using backpropagation learning algorithm, there are few efforts to improve the learning algorithm itself. In this study, we suggest a general way to construct the hidden layer of the neural network using binary genetic algorithm and also propose the various learning methods by which the global minimum value of the teaming error can be obtained. A XOR problem and line heating problems are investigated as examples.

• Journal of the Korean Society of Industry Convergence
• /
• v.3 no.4
• /
• pp.361-367
• /
• 2000

This paper proposes an efficient feature extraction of the image data using nonlinear principal component analysis neural networks of a new learning algorithm. The proposed method is a learning algorithm with momentum for reflecting the past trends. It is to get the better performance by restraining an oscillation due to converge the global optimum. The proposed algorithm has been applied to the cancer image of $256{\times}256$ pixels and the coin image of $128{\times}128$ pixels respectively. The simulation results show that the proposed algorithm has better performances of the convergence and the nonlinear feature extraction, in comparison with those using the backpropagation and the conventional nonlinear PCA neural networks.