• Title/Summary/Keyword: Back Propagation Training Algorithm

Search Result 185, Processing Time 0.025 seconds

NETLA Based Optimal Synthesis Method of Binary Neural Network for Pattern Recognition

  • Lee, Joon-Tark
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.14 no.2
    • /
    • pp.216-221
    • /
    • 2004
  • This paper describes an optimal synthesis method of binary neural network for pattern recognition. Our objective is to minimize the number of connections and the number of neurons in hidden layer by using a Newly Expanded and Truncated Learning Algorithm (NETLA) for the multilayered neural networks. The synthesis method in NETLA uses the Expanded Sum of Product (ESP) of the boolean expressions and is based on the multilayer perceptron. It has an ability to optimize a given binary neural network in the binary space without any iterative learning as the conventional Error Back Propagation (EBP) algorithm. Furthermore, NETLA can reduce the number of the required neurons in hidden layer and the number of connections. Therefore, this learning algorithm can speed up training for the pattern recognition problems. The superiority of NETLA to other learning algorithms is demonstrated by an practical application to the approximation problem of a circular region.

Human Face Recognition used Improved Back-Propagation (BP) Neural Network

  • Zhang, Ru-Yang;Lee, Eung-Joo
    • Journal of Korea Multimedia Society
    • /
    • v.21 no.4
    • /
    • pp.471-477
    • /
    • 2018
  • As an important key technology using on electronic devices, face recognition has become one of the hottest technology recently. The traditional BP Neural network has a strong ability of self-learning, adaptive and powerful non-linear mapping but it also has disadvantages such as slow convergence speed, easy to be traversed in the training process and easy to fall into local minimum points. So we come up with an algorithm based on BP neural network but also combined with the PCA algorithm and other methods such as the elastic gradient descent method which can improve the original network to try to improve the whole recognition efficiency and has the advantages of both PCA algorithm and BP neural network.

A Study on Power Quality Diagnosis System using Neural NetWorks (전기품질 진단 시스템 개발을 위한 인공 신경망 적용에 관한 연구)

  • Kim, Jin-Su;Kim, Young-Il;Kim, Kwang-Soon;Park, Gi-Ju
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.56 no.8
    • /
    • pp.1351-1359
    • /
    • 2007
  • In this paper, we have studied the power quality(PQ) diagnosis system with the two methods for PQ diagnosis. One to Apply a regulation value in compliance with mathematics calculation, and the other Automatic identification using Neural network algorithm. Neural network algorithm is used for an automatic diagnosis of the PQ. The regulation proposed by IEEE 1159 Working group is applied for the precision of the diagnosis. In order to divide accurate segmentation, the algorithm for a computer training used the back propagation out of several neural network algorithms. We have configured the proto-type sample by using Labview and a programmed Neural Networks Algorithm using with C. And arbitrary electric Signal generated by OMICRON Company's CMC 256-6 for an efficiency test.

Evolutionary designing neural networks structures using genetic algorithm

  • Itou, Minoru;Sugisaka, Masanori
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.43.2-43
    • /
    • 2001
  • In this paper, we consider the problems of the evolutionary designed neural networks structures by genetic algorithm. Neural networks has been applied to various application fields since back-propagation algorithm was proposed, e.g. function approximation, pattern or character recognition and so on. However, one of difficulties to use the neural networks. It is how to design the structure of the neural network. Researchers and users design networks structures and training parameters such as learning rate and momentum rate and so on, by trial and error based on their experiences. In the case of designing large scales neural networks, it is very hard work for manually design by try and error. For this difficulty, various structural learning algorithms have been proposed. Especially, the technique of using genetic algorithm for networks structures design has been ...

  • PDF

Damage assessment of cable stayed bridge using probabilistic neural network

  • Cho, Hyo-Nam;Choi, Young-Min;Lee, Sung-Chil;Hur, Choon-Kun
    • Structural Engineering and Mechanics
    • /
    • v.17 no.3_4
    • /
    • pp.483-492
    • /
    • 2004
  • This paper presents an efficient algorithm for the estimation of damage location and severity in bridge structures using Probabilistic Neural Network (PNN). Generally, the Back Propagation Neural Network (BPNN)-based damage detection methods need a lot of training patterns for neural network learning process and the optimum architecture of a BPNN is selected by trial and error. In this paper, the PNN instead of the conventional BPNN is used as a pattern classifier. The modal properties of damaged structure are somewhat different from those of undamaged one. The basic idea of proposed algorithm is that the PNN classifies a test pattern which consists of the modal characteristics from damaged structure, how close it is to each training pattern which is composed of the modal characteristics from various structural damage cases. In this algorithm, two PNNs are sequentially used. The first PNN estimates the damage location using mode shape and the results of the first PNN are put into the second PNN for the damage severity estimation using natural frequency. The proposed damage assessment algorithm using the PNN is applied to a cable-stayed bridge to verify its applicability.

Parameter Estimation of Recurrent Neural Networks Using A Unscented Kalman Filter Training Algorithm and Its Applications to Nonlinear Channel Equalization (언센티드 칼만필터 훈련 알고리즘에 의한 순환신경망의 파라미터 추정 및 비선형 채널 등화에의 응용)

  • Kwon Oh-Shin
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.15 no.5
    • /
    • pp.552-559
    • /
    • 2005
  • Recurrent neural networks(RNNs) trained with gradient based such as real time recurrent learning(RTRL) has a drawback of slor convergence rate. This algorithm also needs the derivative calculation which is not trivialized in error back propagation process. In this paper a derivative free Kalman filter, so called the unscented Kalman filter(UKF), for training a fully connected RNN is presented in a state space formulation of the system. A derivative free Kalman filler learning algorithm makes the RNN have fast convergence speed and good tracking performance without the derivative computation. Through experiments of nonlinear channel equalization, performance of the RNNs with a derivative free Kalman filter teaming algorithm is evaluated.

Non linear vibrations of stepped beam systems using artificial neural networks

  • Bagdatli, S.M.;Ozkaya, E.;Ozyigit, H.A.;Tekin, A.
    • Structural Engineering and Mechanics
    • /
    • v.33 no.1
    • /
    • pp.15-30
    • /
    • 2009
  • In this study, the nonlinear vibrations of stepped beams having different boundary conditions were investigated. The equations of motions were obtained by using Hamilton's principle and made non dimensional. The stretching effect induced non-linear terms to the equations. Natural frequencies are calculated for different boundary conditions, stepped ratios and stepped locations by Newton-Raphson Method. The corresponding nonlinear correction coefficients are also calculated for the fundamental mode. At the second part, an alternative method is produced for the analysis. The calculated natural frequencies and nonlinear corrections are used for training an artificial neural network (ANN) program which has a multi-layer, feed-forward, back-propagation algorithm. The results of the algorithm produce errors less than 2.5% for linear case and 10.12% for nonlinear case. The errors are much lower for most cases except clamped-clamped end condition. By employing the ANN algorithm, the natural frequencies and nonlinear corrections are easily calculated by little errors, and the computational time is drastically reduced compared with the conventional numerical techniques.

Stabilization of Inverted Pendulum Using Neural Network with Genetic Algorithm

  • Jin, Dan;Kim, Kab-Il;Son, Young-I.
    • Proceedings of the KIEE Conference
    • /
    • 2003.11c
    • /
    • pp.425-428
    • /
    • 2003
  • In this paper, the stabilization of an inverted pendulum system is studied. Here, the PID control method is adopted to make the system stable. In order to adjust the PID gains, a three-layer neural network, which is based on the back propagation method, is used. Meanwhile, the time for training the neural network depends on the initial values of PID gains and connection weights. Hence, the genetic algorithm Is considered to shorten the time to find the desired values. Simulation results show the effectiveness of the proposed approach.

  • PDF

Effective Prediction of Thermal Conductivity of Concrete Using Neural Network Method

  • Lee, Jong-Han;Lee, Jong-Jae;Cho, Baik-Soon
    • International Journal of Concrete Structures and Materials
    • /
    • v.6 no.3
    • /
    • pp.177-186
    • /
    • 2012
  • The temperature distributions of concrete structures strongly depend on the value of thermal conductivity of concrete. However, the thermal conductivity of concrete varies according to the composition of the constituents and the temperature and moisture conditions of concrete, which cause difficulty in accurately predicting the thermal conductivity value in concrete. For this reason, in this study, back-propagation neural network models on the basis of experimental values carried out by previous researchers have been utilized to effectively account for the influence of these variables. The neural networks were trained by 124 data sets with eleven parameters: nine concrete composition parameters (the ratio of water-cement, the percentage of fine and coarse aggregate, and the unit weight of water, cement, fine aggregate, coarse aggregate, fly ash and silica fume) and two concrete state parameters (the temperature and water content of concrete). Finally, the trained neural network models were evaluated by applying to other 28 measured values not included in the training of the neural networks. The result indicated that the proposed method using a back-propagation neural algorithm was effective at predicting the thermal conductivity of concrete.

Design of Adaptive-Neuro Controller of SCARA Robot Using Digital Signal Processor (디지털 시그널 프로세서를 이용한 스카라 로봇의 적응-신경제어기 설계)

  • 한성현
    • Journal of the Korean Society of Manufacturing Technology Engineers
    • /
    • v.6 no.1
    • /
    • pp.7-17
    • /
    • 1997
  • During the past decade, there were many well-established theories for the adaptive control of linear systems, but there exists relatively little general theory for the adaptive control of nonlinear systems. Adaptive control technique is essential for providing a stable and robust performance for application of industrial robot control. Neural network computing methods provide one approach to the development of adaptive and learning behavior in robotic system for manufacturing. Computational neural networks have been demonstrated which exhibit capabilities for supervised learning, matching, and generalization for problems on an experimental scale. Supervised learning could improve the efficiency of training and development of robotic systems. In this paper, a new scheme of adaptive-neuro control system to implement real-time control of robot manipulator using digital signal processors is proposed. Digital signal processors, DSPs, are micro-processors that are developed particularly for fast numerical computations involving sums and products of variables. The proposed neuro control algorithm is one of learning a model based error back-propagation scheme using Lyapunov stability analysis method. The proposed adaptive-neuro control scheme is illustrated to be an efficient control scheme for implementation of real-time control for SCARA robot with four-axes by experiment.

  • PDF