• The Transactions of the Korea Information Processing Society
• /
• v.4 no.7
• /
• pp.1759-1769
• /
• 1997

The Error BackPropagation (EBP) algorithm for multi-layered neural networks is widely used in various areas such as associative memory, speech recognition, pattern recognition and robotics, etc. Nevertheless, many researchers have continuously published papers about improvements over the original EBP algorithm. The main reason for this research activity is that EBP is exceeding slow when the number of neurons and the size of training set is large. In this study, we developed new learning speed acceleration methods using variable learning rate, variable momentum rate and variable slope for the sigmoid function. During the learning process, these parameters should be adjusted continuously according to the total error of network, and it has been shown that these methods significantly reduced learning time over the original EBP. In order to show the efficiency of the proposed methods, first we have used binary data which are made by random number generator and showed the vast improvements in terms of epoch. Also, we have applied our methods to the binary-valued Monk's data, 4, 5, 6, 7-bit parity checker and real-valued Iris data which are famous benchmark training sets for machine learning.

• Proceedings of the Korean Information Science Society Conference
• /
• 1999.10b
• /
• pp.324-326
• /
• 1999

현대는 빠른 기술의 발달과 제품의 대량 생산에 의한 가격의 인하로 인해 칼라 스캐너, 칼라 모니터와 칼라 프린터 같은 컴퓨터 주변 칼라 장비들이 널리 보급되었다. 뿐만 아니라 이들 장비들의 성능도 날이 갈수록 향상되고 있다. 그러나 이들 장비간의 칼라 재현 기술과 칼라 일치 문제에는 아직도 왜곡 현상이 남아 있어 이를 해결하기 위한 방법이 많이 연구되고 있다. 신경회로망에 의한 방법은 각 칼라 장비들의 특성을 쉽게 모델링 할 수 있을 뿐만 아니라 별도의 참조 테이블을 구성 할 것도 없이 직접 원하는 칼라 값으로의 매핑이 가능하기 때문에 효율적이다. 여기서는 신경회로망의 오차역전파(Error Back Propagation:EBP) 알고리즘을 이용하여 칼라 스캐너와 칼라 프린터의 모델링 구현과 이를 통합한 통합형 모델을 제시하고 나아가 이를 구현하기 위한 방법과 문제점에 대해 알아본다.

• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.33B no.3
• /
• pp.186-192
• /
• 1996

A modified learning rule is introduced for the implementation of feedforward artificial neural networks with on-chip learning circuitry using standard analog CMOS technology. Learning rule, is modified form the EBP (error back propagation) rule which is one of the well-known learning rules for the feedforward rtificial neural nets(FANNs). The employed MEBP ( modified EBP) rule is well - suited for the hardware implementation of FANNs with on-chip learning rule. As a ynapse circuit, a four-quadrant vector-product linear multiplier is employed, whose input/output signals are given with voltage units. Two $2{\times}2{\times}1$ FANNs are implemented with the learning circuitry. The implemented FANN circuits have been simulatied with learning test patterns using the PSPICE circuit simulator and their results show correct learning functions.

• 제어로봇시스템학회:학술대회논문집
• /
• 1994.10a
• /
• pp.737-741
• /
• 1994

We show an application of a genetic algorithm to, control systems including neural networks. Genetic algorithms are getting more popular nowadays because of their simplicity and robustness. Genetic algorithms are global search techniques for optimization and many other problems. A feed-forward neural network which is widely used in control applications usually learns by error back propagation algorithm(EBP). But, when there exist certain constraints, EBP can not be applied. We apply a modified genetic algorithm to such a case. We show simulation examples of two cart-pole nonlinear systems: single pole and double pole.

• KIEE International Transaction on Systems and Control
• /
• v.12D no.1
• /
• pp.27-32
• /
• 2002

In this paper, we would study the applicability of neural networks to the recognition process of Korean stenographic character image, applying the classification function, which is the greatest merit of those of neural networks applied to the various parts so far, to the stenographic character recognition, relatively simple classification work. Korean stenographic recognition algorithms, which recognize the characters by using some methods, have a quantitative problem that despite the simplicity of the structure, a lot of basic characters are impossible to classify into a type. They also have qualitative one that It Is not easy to classify characters fur the delicacy of the character farms. Even though this is the result of experiment under the limited environment of the basic characters, this shows the possibility that the stenographic characters can be recolonized effectively by neural network system. In this system, we got 90.86% recognition rate as an average.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2003.09a
• /
• pp.644-647
• /
• 2003

This paper describes a neural network based machine vision system designed for inspecting yellow beans in real time. The system consists of a camera. lights, a belt conveyor, air ejectors, and a computer. Beans are conveyed in four lines on a belt and their images are taken by a monochrome line scan camera when they fall down from the belt. Beans are separated easily from their background on images by back-lighting. After analyzing the image, a decision is made by a multilayer artificial neural network (ANN) trained by the error back-propagation (EBP) algorithm. We use the global mean, variance and local change of gray levels of a bean for the input nodes of the network. In an our experiment, the system designed could process about 520kg/hour.

• Journal of Advanced Marine Engineering and Technology
• /
• v.25 no.2
• /
• pp.383-394
• /
• 2001

The stabilization control of inverted pendulum (IP) system is difficult because of its nonlinearity and structural unstability. In this paper, an Evolving Neural Network Controller (ENNC) without Error Back Propagation (EBP) is presented. An ENNC is described simply by genetic representation using an encoding strategy for types and slope values of each active functions, biases, weights and so on. By an evolutionary programming which has three genetic operation; selection, crossover and mutation, the predetermine controller is optimally evolved by updating simultaneously the connection patterns and weights of the neural networks. The performances of the proposed ENNC(PENNC)are compared with the one of conventional optimal controller and the conventional evolving neural network controller (CENNC) through the simulation and experimental results. And we showed that the finally optimized PENNC was very useful in the stabilization control of an IP system.

• Magazine of the Korean Society of Agricultural Engineers
• /
• v.43 no.2
• /
• pp.69-77
• /
• 2001

An artificial neural network model was developed to analyze and forecast daily steamflow flow a small watershed. Error Back propagation neural networks (EBPN) of daily rainfall and runoff data were found to have a high performance in simulating stremflow. The model adopts a gradient descent method where the momentum and adaptive learning rate concepts were employed to minimize local minima value problems and speed up the convergence of EBP method. The number of hidden nodes was optimized using Bayesian information criterion. The resulting optimal EBPN model for forecasting daily streamflow consists of three rainfall and four runoff data (Model34), and the best number of the hidden nodes were found to be 13. The proposed model simulates the daily streamflow satisfactorily by comparison compared to the observed data at the HS#3 watershed of the Baran watershed project, which is 391.8 ha and has relatively steep topography and complex land use.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.14 no.2
• /
• pp.216-221
• /
• 2004

This paper describes an optimal synthesis method of binary neural network for pattern recognition. Our objective is to minimize the number of connections and the number of neurons in hidden layer by using a Newly Expanded and Truncated Learning Algorithm (NETLA) for the multilayered neural networks. The synthesis method in NETLA uses the Expanded Sum of Product (ESP) of the boolean expressions and is based on the multilayer perceptron. It has an ability to optimize a given binary neural network in the binary space without any iterative learning as the conventional Error Back Propagation (EBP) algorithm. Furthermore, NETLA can reduce the number of the required neurons in hidden layer and the number of connections. Therefore, this learning algorithm can speed up training for the pattern recognition problems. The superiority of NETLA to other learning algorithms is demonstrated by an practical application to the approximation problem of a circular region.

• Proceedings of the KIEE Conference
• /
• 1989.11a
• /
• pp.186-190
• /
• 1989

A Study for Bad Data Processing in state estimation by a Neural Network is presented. State estimation is the process of assigning a value to an unknown system state variable based on measurement from that system according to some criteria. In this case, the ability to detect and identify bad measurements is extremely valuable, and much time in oder to achieve the state estimation is needed. This paper proposed new bad data processing using Neural Network in order to settle it. The concept of neural net is a parallel distributed processing. In this paper, EBP (Error Back Propagation) algorithm based on three layered feed forward network is used.