• The Journal of Information Technology
• /
• v.8 no.1
• /
• pp.51-56
• /
• 2005

The Back propagation algorithm is a very effective supervised training method for multi-layer feed forward neural networks. This paper studies the decision boundary formation based on the Back propagation algorithm. The discriminating powers of several neural network topology are also investigated against five manually created data sets. It is found that neural networks with multiple hidden layer perform better than single hidden layer.

• Journal of Navigation and Port Research
• /
• v.32 no.8
• /
• pp.589-596
• /
• 2008

In this paper, Artificial Neural Network(ANN) is applied to automatic berthing control for a ship. ANN is suitable for a maneuvering such as ship's berthing, because it can describe non-linearity of the system. Multi-layer perceptron which has more than one hidden layer between input layer and output layer is applied to ANN. Using a back-propagation algorithm with teaching data, we trained ANN to get a minimal error between output value and desired one. For the automatic berthing control of a containership, we introduced low speed maneuvering mathematical models. The berthing control with the structure of 8 input layer units in ANN is compared to 6 input layer units. From the simulation results, the berthing conditions are satisfied, even though the berthing paths are different.

• Journal of Advanced Marine Engineering and Technology
• /
• v.21 no.1
• /
• pp.66-70
• /
• 1997

In this paper a new learning algorithm for curvature smoothing and improved generalization for multi-layer neural networks is proposed. To enhance the generalization ability a constraint term of hidden neuron activations is added to the conventional output error, which gives the curvature smoothing characteristics to multi-layer neural networks. When the total cost consisted of the output error and hidden error is minimized by gradient-descent methods, the additional descent term gives not only the Hebbian learning but also the synaptic weight decay. Therefore it incorporates error back-propagation, Hebbian, and weight decay, and additional computational requirements to the standard error back-propagation is negligible. From the computer simulation of the time series prediction with Santafe competition data it is shown that the proposed learning algorithm gives much better generalization performance.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 1998.10a
• /
• pp.560-567
• /
• 1998

This paper concerned about a imputed color printed material image in camera to decrease noise and distortion by processing median filtering with input image to identical condition. Also this paper proposed the way of compares a normal printed material with an abnormal printed material color tone with trained a learning of the error back-propagation to block classification by extracting five place from identical block(3${\times}$3) of color printed material R, G, B value. As a representative algorithm of multi-layer perceptron the error Back-propagation technique used to solve complex problems. However, the Error Back-propagation is algorithm which basically used a gradient descent method which can be converged to local minimum and the Back Propagation train include problems, and that may converge in a local minimum rather than get a global minimum. The network structure appropriate for a given problem. In this paper, a good result is obtained by improve initial condition and adjust th number of hidden layer to solve the problem of real time process, learning and train.

• Journal of the Korean Institute of Telematics and Electronics C
• /
• v.35C no.3
• /
• pp.79-89
• /
• 1998

The Error Back-Propagation(EBP) algorithm is widely applied to train a multi-layer perceptron, which is a neural network model frequently used to solve complex problems such as pattern recognition, adaptive control, and global optimization. However, the EBP is basically a gradient descent method, which may get stuck in a local minimum, leading to failure in finding the globally optimal solution. Moreover, a multi-layer perceptron suffers from locking a systematic determination of the network structure appropriate for a given problem. It is usually the case to determine the number of hidden nodes by trial and error. In this paper, we propose a new algorithm to efficiently train a multi-layer perceptron. OUr algorithm uses stochastic perturbation in the weight space to effectively escape from local minima in multi-layer perceptron learning. Stochastic perturbation probabilistically re-initializes weights associated with hidden nodes to escape a local minimum if the probabilistically re-initializes weights associated with hidden nodes to escape a local minimum if the EGP learning gets stuck to it. Addition of new hidden nodes also can be viewed asa special case of stochastic perturbation. Using stochastic perturbation we can solve the local minima problem and the network structure design in a unified way. The results of our experiments with several benchmark test problems including theparity problem, the two-spirals problem, andthe credit-screening data show that our algorithm is very efficient.

• Proceedings of the IEEK Conference
• /
• 2000.07b
• /
• pp.1041-1044
• /
• 2000

The enhancement to the back-propagation algorithm presented in this paper has resulted from the need to extract sparsely connected networks from networks employing product terms. The enhancement works in conjunction with the back-propagation weight update process, so that the actions of weight zeroing and weight stimulation enhance each other. It is shown that the error measure, can also be interpreted as rate of weight change (as opposed to ${\Delta}W_{ij}$), and consequently used to determine when weights have reached a stable state. Weights judged to be stable are then compared to a zero weight threshold. Should they fall below this threshold, then the weight in question is zeroed. Simulation of such a system is shown to return improved learning rates and reduce network connection requirements, with respect to the optimal network solution, trained using the normal back-propagation algorithm for Multi-Layer Perceptron (MLP), Higher Order Neural Network (HONN) and Sigma-Pi networks.

• Proceedings of the Korean Society of Machine Tool Engineers Conference
• /
• 2003.10a
• /
• pp.125-130
• /
• 2003

This Paper describes a Nonlinear adoptive noise canceller using Neural Network for Machine Tools Controller System. Back-Propagation Learning Algorithm based MLP (Multi Layer Perceptron)is used an adaptive filters. In this Paper. it assume that the noise of primary input in the adaptive noise canceller is not the same characteristic as that of the reference input. Experimental results show that the neural network base noise canceller outperforms the linear noise canceller. Especially to make noise cancel close to realtime, Primary Input is divided by Unit and each divided pan is processed for very short time than all the processed data are unified to whole data.

• Proceedings of the Korean Society of Machine Tool Engineers Conference
• /
• 2004.10a
• /
• pp.345-351
• /
• 2004

This Paper describes a nonlinear adaptive noise filter using neural network for digital controller system. Back-Propagation Learning Algorithm based MLP (Multi Layer Perceptron)is used an adaptive filters. In this paper. it assume that the noise of primary input in the adaptive noise canceller is not the same characteristic as that of the reference input. Experimental reaults show that the neural network base noise canceller outperforms the linear noise canceller. Especially to make noise cancel close to realtime, Primary input is divided by unit and each divided part is processed for very short time than all the processed data are unified to whole data.

• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.29B no.1
• /
• pp.58-66
• /
• 1992

This paper proposes a neuro-controller for position control of one-link flexible robot arm. Basically the controller consists of a multi-layer neural network and a conventional PD controller. Two controller are parallelly connected. Neural network is traind by the conventional error back propagation learning rules. During learning period, the weights of neural network are adjusted to minimize the position error between the desired hub angle and the actual one. Finally the effectiveness of the proposed approach will be demonstrated by computer simulation.

• Proceedings of the KIEE Conference
• /
• 1991.07a
• /
• pp.896-899
• /
• 1991

This paper presents the neural network method to predict the Korea composition stock price index. The error back-propagation method is used to train the multi-layer perceptron network. Ten of the various economic indices of the past 7 Nears are used as train data and the monthly transition of the composition stock price index is represented by five output neurons. Test results of this method using the data of the last 18 months are very encouraging.