• Journal of information and communication convergence engineering
• /
• 제1권3호
• /
• pp.104-108
• /
• 2003

A biologically inspired fuzzy multilayer perceptron is proposed in this paper. The proposed algorithm is established under consideration of biological neuronal structure as well as fuzzy logic operation. We applied this suggested learning algorithm to benchmark problem in neural network such as exclusive OR and 3-bit parity, and to digit image recognition problems. For the comparison between the existing and proposed neural networks, the convergence speed is measured. The result of our simulation indicates that the convergence speed of the proposed learning algorithm is much faster than that of conventional backpropagation algorithm. Furthermore, in the image recognition task, the recognition rate of our learning algorithm is higher than of conventional backpropagation algorithm.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 1998년도 추계종합학술대회 논문집
• /
• pp.1281-1284
• /
• 1998

This paper proposes an efficient time series prediction of the nonlinear dynamical discrete-time systems using multilayer neural networks of a hybrid learning algorithm. The proposed learning algorithm is a hybrid backpropagation algorithm based on the steepest descent for high-speed optimization and the dynamic tunneling for global optimization. The proposed algorithm has been applied to the y00 samples of 700 sequences to predict the next 100 samples. The simulation results shows that the proposed algorithm has better performances of the convergence and the prediction, in comparision with that using backpropagation algorithm based on the gradient descent for multilayer neural network.

• 대한전자공학회논문지TE
• /
• 제39권4호
• /
• pp.363-369
• /
• 2002

본 논문은 적응성 뉴로-퍼지 인터페이스 시스템(Adaptive Neuro-Fuzzy Inference System : ANFIS)과 웨이브렛 변환 다중해상도 분해(multi-resolution Analysis : MRA)을 기반으로 한 웨이브렛 신경망을 가지고 임의의 비선형 함수 학습 근사화를 개선하는 것이다. ANFIS 구조는 벨형 퍼지 소속 함수로 구성이 되었으며, 웨이브렛 신경망은 전파 알고리즘과 역전파 신경망 알고리즘으로 구성되었다. 이 웨이브렛 구성은 단일 크기이고, ANFIS 기반 웨이브렛 신경망의 학습을 위해 역전파 알고리즘을 사용하였다. 1차원과 2차원 함수에서 웨이브렛 전달 파라미터 학습과 ANFIS의 벨형 소속 함수를 이용한 ANFIS 모델 기반 웨이브렛 신경망의 웨이브렛 기저 수 감소와 수렴 속도 성능이 기존의 알고리즘 보다 개선되었음을 확인하였다.

• Journal of Welding and Joining
• /
• 제21권1호
• /
• pp.80-86
• /
• 2003

This study develops a system for effective prediction of residual stresses by the backpropagation algorithm using the neural network. To achieve this goal, a series of experiments were carried out to and measured the residual stresses using the sectional method. With the experimental results, the optional control algorithms using a neural network could be developed in order to reduce the effect of the external disturbances during GMA welding processes. Then the results obtained from this study were compared between the measured and calculated results, weld guality might be controlled by the neural network based on backpropagation algorithm.. This system can not only help to understand the interaction between the process parameters and residual stress, but also improve the quantity control for welded structures.

• 한국공작기계학회:학술대회논문집
• /
• 한국공작기계학회 2000년도 춘계학술대회논문집 - 한국공작기계학회
• /
• pp.484-490
• /
• 2000

The abjective of the study is the development of the system for effective prediction of residual stresses using the backpropagation algorithm from the neural network. To achieve this goal, the series experiment were carried out and measured the residual stresses using the sectional method. Using the experimental results, the optional control algorithms using a neural network should be developed in order to reduce the effect of the external disturbances on during GMA welding processes. Then the results obtained from this study were compared between the measured and calculated results, the neural network based on backpropagation algorithm might be controlled weld quality. This system can not only help to understand the interaction between the process parameters and residual stress, but also improve the quantity control for welded structures.

• 한국통신학회논문지
• /
• 제16권1호
• /
• pp.35-45
• /
• 1991

본 논문에서는 Backpropagation 학습 이론을 사용한 다층 구조 신경 회로망을 이용하여 3차원적으로 왜곡된 항공기 인식과 항공기의 3차원 회전 방향 추정을 컴퓨터 시뮬레이션을 통하여 수행하였다. 항공기 영상으로 부터 2차원 영상에서 왜곡 불변 (distortion invariant)특정을 가지는 피치 $(L,\;{\Phi})$를 추출하여 신경 회로망 항공기 인식기의 학습(training)에 사용하였다. 그리고 신경 회로망 인식기 설계시 그 구조를 최적화 함으로써 높은 인식률을 가지는 항공기 인식기를 구성하였다. 신경 회로망 학습 과정에서 학습 이론으로는 변형된 backpropagation 학습 이론을 도입하고 아울러 학습 수행중에 학습 변수(learning parameter)값을 변화 시키는 방법을 사용하여 전체 학습 시간을 효과적으로 단축시킬 수 있었다.

• 대한전기학회:학술대회논문집
• /
• 대한전기학회 2004년도 학술대회 논문집 정보 및 제어부문
• /
• pp.349-351
• /
• 2004

The classical dynamic backpropagation learning algorithm has the problems of learning speed and the determine of learning parameter. The Extend Kalman Filter(EKF) is used effectively for a state estimation method for a non linear dynamic system. This paper presents a learning algorithm using Dual Extended Kalman Filter(DEKF) for Fully Recurrent Neural Network(FRNN). This DEKF learning algorithm gives the minimum variance estimate of the weights and the hidden outputs. The proposed DEKF learning algorithm is applied to the system identification of a nonlinear SISO system and compared with dynamic backpropagation learning algorithm.

• 한국통신학회논문지
• /
• 제28권10C호
• /
• pp.1007-1012
• /
• 2003

Multilayer perceptrons (MLPs)를 위한 일반적인 BP 알고리즘의 학습 속도를 개선하기 위하여 제약을 갖는 최적화 기술을 제안하고 이를 backpropagation (BP) 알고리즘에 적용한다. 먼저 잡음 제약을 갖는 LMS (noise constrained least mean square : NCLMS) 알고리즘과 영잡음 제약 LMS (ZNCLMS) 알고리즘을 BP 알고리즘에 적용한다. 이러한 알고리즘들은 다음과 같은 가정을 반드시 필요로 하여 알고리즘의 이용에 많은 제약을 갖는다. NCLMS 알고리즘을 이용한 NCBP 알고리즘은 정확한 잡음 전력을 알고 있다고 가정한다. 또한 ZNCLMS 알고리즘을 이용한 ZNCBP 알고리즘은 잡음의 전력을 0으로 가정, 즉 잡음을 무시하고 학습을 진행한다. 본 논문에서는 확장된(augmented) Lagrangian multiplier를 이용하여, 비용함수(cost function)를 변형한다. 이를 통하여 잡음에 대한 가정을 제거하고 ZNCBP와 NCBP 알고리즘을 확장, 일반화하여 적응 오류 제약 BP(adaptive error constrained BP : AECBP) 알고리즘을 유도, 제안한다. 제안한 알고리즘들의 수렴 속도는 일반적인 BP 알고리즘보다 약 30배정도 빠른 학습 속도를 나타내었으며, 일반적인 선형 필터와 거의 같은 수렴속도를 나타내었다.

• 한국전산구조공학회:학술대회논문집
• /
• 한국전산구조공학회 1998년도 봄 학술발표회 논문집
• /
• pp.216-225
• /
• 1998

Although artificial neural network based on backpropagation algorithm is an excellent system simulator, it has still unsolved problems of its structure-decision and learning method. That is, we cannot find a general approach to decide the structure of the neural network and cannot train it satisfactorily because of the local optimum point which it frequently falls into. In addition, although there are many successful applications using backpropagation learning algorithm, there are few efforts to improve the learning algorithm itself. In this study, we suggest a general way to construct the hidden layer of the neural network using binary genetic algorithm and also propose the various learning methods by which the global minimum value of the teaming error can be obtained. A XOR problem and line heating problems are investigated as examples.

• 한국산업융합학회 논문집
• /
• 제3권4호
• /
• pp.361-367
• /
• 2000

This paper proposes an efficient feature extraction of the image data using nonlinear principal component analysis neural networks of a new learning algorithm. The proposed method is a learning algorithm with momentum for reflecting the past trends. It is to get the better performance by restraining an oscillation due to converge the global optimum. The proposed algorithm has been applied to the cancer image of $256{\times}256$ pixels and the coin image of $128{\times}128$ pixels respectively. The simulation results show that the proposed algorithm has better performances of the convergence and the nonlinear feature extraction, in comparison with those using the backpropagation and the conventional nonlinear PCA neural networks.