• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.38 no.6
• /
• pp.26-37
• /
• 2001

In order to improve the several problems of the general backpropagation, we propose a method using a fuzzy logic system for automatic tuning of the activation function gain in the backpropagation. First, we researched that the changing of the gain of sigmoid function is equivalent to changing the learning rate, the weights, and the biases. The inputs of the fuzzy logic system were the sensitivity of error respect to the last layer and the mean sensitivity of error respect to the hidden layer, and the output was the gain of the sigmoid function. In order to verify the effectiveness of the proposed method, we performed simulations on the parity problem, function approximation, and pattern recognition. The results show that the proposed method has considerably improved the performance compared to the general backpropagation.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 1993.10a
• /
• pp.488-492
• /
• 1993

This paper proposes a new approach to the optimization method of a blending process with neural network. The method is based on the error backpropagation learning algorithm for neural network. Since the neural network can model an arbitrary nonlinear mapping, it is used as a system solver. A fuzzy membership function is used in parallel with the neural network to minimize the difference between measurement value and input value of neural network. As a result, we can guarantee the reliability and stability of blending process by the help of neural network and fuzzy membership function.

• Proceedings of the Korean Information Science Society Conference
• /
• 1998.10c
• /
• pp.580-582
• /
• 1998

인터넷의 보급으로 인하여 디지털 데이터의 복제가 확산됨에 따라 멀티미디어 데이터에 대한 소유권 보호와 인증에 대한 문제가 대두되고 있는 실정이다. 본 논문에서는 디지털 영상을 다중해상도 표현이 가능한 웨이브릿 변환(Wavelet Transform)을 통하여 저주파수 영역에 인간 시각으로 지각 할 수 없는 워터마크를 삽입하고, 삽입된 워터마크의 영상을 인증하기 위한 방법으로 오류 역전파 학습 알고리즘(Error Backpropagation)을 이용한 신경회로망적 접근방법을 제안한다. 워터마크를 추출하기 위해서는 원영상이 필요하고, 내장된 워터마크가 손실 압축과 필터링 등의 일반적인 영상 처리에 강인함을 실험 결과를 증명하고, 제안한 신경회로망적 접근방법이 좋은 결과를 나타냄으로 실험을 통하여 증명하였다.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.26 no.9B
• /
• pp.1292-1298
• /
• 2001

본 논문에서는 공간 영역에서의 블록 분류 (block classification)와 순방향 신경망 필터(feedforward neural network filter)를 이용한 블록 기반 부호화에서의 적응적 블록화 현상 제거 알고리듬을 제안하였다. 제안한 방법에서는 각 블록 경계를 인접 블록간의 통계적 특성을 이용하여 평탄 영역과 에지 영역으로 분류한 후, 각 영역에 대하여 블록화 현상이 발생하였다고 분류된 클래스에 대하여 적응적인 블록간 필터링을 수행한다. 즉, 평탄 영역으로 분류된 영역 중 블록화 현상이 발생한 영역은 오류 역전파 학습 알고리듬 (error backpropagation learning algorithm)에 의하여 학습된 2계층 (2-layer) 신경망 필터를 이용하여 블록화 현상을 제거하고, 복잡한 영역으로 분류된 영역 중 블록화 현상이 발생한 영역은 에지 성분을 보존하기 위하여 선형 내삽을 이용하여 블록간 인접 화소의 밝기 값만을 조정함으로써 블록화 현상을 제거한다. 모의 실험 결과를 통하여 제안한 방법이 객관적 화질 및 주관적 화질 측면에서 기존의 방법보다 그 성능이 우수함을 확인하였다.

• Proceedings of the KIEE Conference
• /
• 2000.07b
• /
• pp.1159-1161
• /
• 2000

This paper presents a speed control system of induction motor using neural network The speed control of induction motor was designed to NNC(Neural Network Controller) and NNE(Neural Network Estimator) used backpropagation, the NNE was constituted to be get an error value of output of an induction motor and conspire an input/output. NNC is controled to be made the error of reference speed and actual speed decrease, and in order to determine the weighting of NNC can be back propagated through the NNE, and it is adapted to the outside circumstances and system characters with learning ability.

• Proceedings of the Korea Institute of Convergence Signal Processing
• /
• 2000.12a
• /
• pp.201-204
• /
• 2000

This paper describes a study on the time-varying control of parameters in learning of the neural network. Elman recurrent neural network (RNN) is used to implement the control of parameters. The parameters of learning and momentum rates In the error backpropagation algorithm ate updated at every iteration using fuzzy rules based on performance index. In addition, the gain and slope of the neuron's activation function are also considered time-varying parameters. These function parameters are updated using the gradient descent algorithm. Simulation results show that the auto-tuned learning algorithm results in faster convergence and lower system error than regular backpropagation in the system identification.

• Proceedings of the KIEE Conference
• /
• 2007.07a
• /
• pp.1730-1731
• /
• 2007

In this paper, we present a direct adaptive control method using neural networks for the control of nonlinear systems. The weights of neural networks are trained by an adaptive backpropagation algorithm based on Lyapunov stability theory. We develop the parameter update-laws using the neural network input and the error between the desired output and the output of nonlinear plant to update the weights of a neural network in the sense that Lyapunove stability theory. Beside the output tracking error is asymptotically converged to zero.

• Proceedings of the Korean Information Science Society Conference
• /
• 2004.04b
• /
• pp.568-570
• /
• 2004

The error-backpropagation (EBP) algerithm for training multilayer perceptrons (MLPs) is known to have good features of robustness and economical efficiency. However, the algorithm has difficulty in selecting an optimal constant learning rate and thus results in non-optimal learning speed and inflexible operation for working data. This paper Introduces an elastic learning rate that guarantees convergence of learning and its local realization by online upoate of MLP parameters Into the original EBP algorithm in order to complement the non-optimality. The results of experiments on a speaker verification system with Korean speech database are presented and discussed to demonstrate the performance improvement of the proposed method in terms of learning speed and flexibility fer working data of the original EBP algorithm.

• 제어로봇시스템학회:학술대회논문집
• /
• 2004.08a
• /
• pp.1033-1036
• /
• 2004

The study on speech recognition and understanding has been done for many years. In this paper, we propose a new type of recurrent neural network architecture for speech recognition, in which each output unit is connected to itself and is also fully connected to other output units and all hidden units [1]. Besides that, we also proposed the new architecture and the learning algorithm of recurrent neural network such as Backpropagation Through Time (BPTT, which well-suited. The aim of the study was to observe the difference of Arabic's alphabet like "alif" until "ya". The purpose of this research is to upgrade the people's knowledge and understanding on Arabic's alphabet or word by using Recurrent Neural Network (RNN) and Backpropagation Through Time (BPTT) learning algorithm. 4 speakers (a mixture of male and female) are trained in quiet environment. Neural network is well-known as a technique that has the ability to classified nonlinear problem. Today, lots of researches have been done in applying Neural Network towards the solution of speech recognition [2] such as Arabic. The Arabic language offers a number of challenges for speech recognition [3]. Even through positive results have been obtained from the continuous study, research on minimizing the error rate is still gaining lots attention. This research utilizes Recurrent Neural Network, one of Neural Network technique to observe the difference of alphabet "alif" until "ya".

• Composites Research
• /
• v.14 no.5
• /
• pp.26-37
• /
• 2001

After impact analysis of the composite cylindrical shells was performed. obtained outputs at 9 equally divided points of the shell were used as input patterns of the neural networks. Identification of impact loading characteristics was predicted simultaneously. Momentum backpropagation algorithm of neural networks which can modify the momentum coefficient and learning rate was developed and applied to identify the loading characteristics. Hidden layers of the backpropagation increased from 1 layer to 3 layers and trained the loading characteristics. Developed program with variable learning rate was converged close to real load characteristics under 1% error. Inverse engineering which identify the impact loading characteristics can be applicable to the composite laminated cylindrical shells with developed neural networks.