• Title/Summary/Keyword: back-propagation learning algorithm

Search Result 386, Processing Time 0.021 seconds

Self-Adaptive Learning Algorithm for Training Multi-Layered Neural Networks and Its Applications (다층 신경회로망의 자기 적응 학습과 그 응용)

  • Cheung, Wan-Sup;Jho, Moon-Jae;Hammond, Joseph K.
    • The Journal of the Acoustical Society of Korea
    • /
    • v.13 no.1E
    • /
    • pp.25-36
    • /
    • 1994
  • A problem of making a neural network learning self-adaptive to the training set supplied is addressed in this paper. This arises from the aspect in choice of an adequate stepsize for the update of the current weigh vectors according to the training pairs. Related issues in this attempt are raised and fundamentals in neural network learning are introduced. In comparison to the most popular back-propagation scheme, the usefulness and superiority of the proposed weight update algorithm are illustrated by examing the identification of unknown nonlinear systems only from measurements.

  • PDF

NETLA Based Optimal Synthesis Method of Binary Neural Network for Pattern Recognition

  • Lee, Joon-Tark
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.14 no.2
    • /
    • pp.216-221
    • /
    • 2004
  • This paper describes an optimal synthesis method of binary neural network for pattern recognition. Our objective is to minimize the number of connections and the number of neurons in hidden layer by using a Newly Expanded and Truncated Learning Algorithm (NETLA) for the multilayered neural networks. The synthesis method in NETLA uses the Expanded Sum of Product (ESP) of the boolean expressions and is based on the multilayer perceptron. It has an ability to optimize a given binary neural network in the binary space without any iterative learning as the conventional Error Back Propagation (EBP) algorithm. Furthermore, NETLA can reduce the number of the required neurons in hidden layer and the number of connections. Therefore, this learning algorithm can speed up training for the pattern recognition problems. The superiority of NETLA to other learning algorithms is demonstrated by an practical application to the approximation problem of a circular region.

Improved algorithm for learning speed by using the slope of activation function (활성화함수의 기울기를 이용한 수렴속도 개선 알고리듬)

  • Kim, D.K.;Lee, S.H.;Kim, B.S.;Kwon, H.Y.
    • Proceedings of the KIEE Conference
    • /
    • 1992.07a
    • /
    • pp.480-483
    • /
    • 1992
  • Although the back-propagation(BP) algorithm is widely used for its simple structure and easy learning method, it has a drawback of slow convergence rate. In this paper, we propose an algorithm to improve this problem by manipulating the slope parameter of the activation function. The steepest descent method is used in learning the slope parameter, as in the case of weight. The simulation shows that the learning rates of the proposed algorithm is faster than the conventional BP algorithm.

  • PDF

Intelligent control system design of track vehicle based-on fuzzy logic (퍼지 로직에 의한 궤도차량의 지능제어시스템 설계)

  • 김종수;한성현;조길수
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.131-134
    • /
    • 1997
  • This paper presents a new approach to the design of intelligent control system for track vehicle system using fuzzy logic based on neural network. The proposed control scheme uses a Gaussian function as a unit function in the neural network-fuzzy, and back propagation algorithm to train the fuzzy-neural network controller in the framework of the specialized learning architecture. It is proposed a learning controller consisting of two neural network-fuzzy based on independent reasoning and a connection net with fixed weights to simply the neural networks-fuzzy. The performance of the proposed controller is illustrated by simulation for trajectory tracking of track vehicle speed.

  • PDF

Application of Neural Networks For Estimating Evapotranspiration

  • Lee, Nam-Ho
    • Proceedings of the Korean Society for Agricultural Machinery Conference
    • /
    • 1993.10a
    • /
    • pp.1273-1281
    • /
    • 1993
  • Estimation of daily and seasonal evaportranspiration is essential for water resource planning irrigation feasibility study, and real-time irrigation water management . This paper is to evaluate the applicability of neural networks to the estimation of evapotranspiration . A neural network was developed to forecast daily evapotranspiration of the rice crop. It is a three-layer network with input, hidden , and output layers. Back-propagation algorithm with delta learning rule was used to train the neural network. Training neural network wasconducted usign daily actural evapotranspiration of rice crop and daily climatic data such as mean temperature, sunshine hours, solar radiation, relative humidity , and pan evaporation . During the training, neural network parameters were calibrated. The trained network was applied to a set of field data not used in the training . The created response of the neural network was in good agreement with desired values. Evaluating the neural networ performance indicates that neural network may be applied to the estimation of evapotranspiration of the rice crop.

  • PDF

Dynamic Control of Track Vehicle Using Fuzzy-Neural Control Method (퍼지-뉴럴 제어기법에 의한 궤도차량의 동적 제어)

  • 한성현;서운학;조길수;윤강섭
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 1997.04a
    • /
    • pp.133-139
    • /
    • 1997
  • This paper presents a new approach to the dynamic control technique for track vehicle system using neural network-fuzzy control method. The proposed control scheme uses a Gaussian function as a unit function in the neural network-fuzzy, and back propagation algorithm to train the fuzzy-neural network controller in the framework of the specialized learning architecture. It is propored a learning controller consisting of two neural network-fuzzy based on independent resoning and a connection net with fixed weights to simply the neural network-fuzzy. The performance of the proposed controller is shown by simulation for trajectory tracking of the speed and azimuth of a track vehicle

  • PDF

A Study on the Neuro-Fuzzy Control and Its Application

  • So, Myung-Ok;Yoo, Heui-Han;Jin, Sun-Ho
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.28 no.2
    • /
    • pp.228-236
    • /
    • 2004
  • In this paper. we present a neuro-fuzzy controller which unifies both fuzzy logic and multi-layered feed forward neural networks. Fuzzy logic provides a means for converting linguistic control knowledge into control actions. On the other hand. feed forward neural networks provide salient features. such as learning and parallelism. In the proposed neuro-fuzzy controller. the parameters of membership functions in the antecedent part of fuzzy inference rules are identified by using the error back propagation algorithm as a learning rule. while the coefficients of the linear combination of input variables in the consequent part are determined by using the least square estimation method. Finally. the effectiveness of the proposed controller is verified through computer simulation for an inverted pole system.

Development of a Supporting System for Nutrient Solution Management in Hydroponics - II. Estimation of Electrical Conductivity(EC) using Neural Networks (양액재배를 위한 배양액관리 지원시스템의 개발 - II. 신경회로망에 의한 전기전도도(EC)의 추정)

  • 손정익;김문기;남상운
    • Journal of Bio-Environment Control
    • /
    • v.1 no.2
    • /
    • pp.162-168
    • /
    • 1992
  • As the automation of nutrient solution management proceeds in the field of hydroponics, effective supporting systems to manage the nutrient solution by computer become needed. This study was attempt to predict the EC of nutrient solution using the neural networks. The multilayer perceptron consisting of 3 layers with the back propagation learning algorithm was selected for EC prediction, of which nine variables in the input layer were the concentrations of each ion and one variable in the output layer the EC of nutrient solution. The meq unit in ion concentration was selected fir input variable in the input layer. After the 10,000 learning sweeps with 108 sample data, the comparison of predicted and measured ECs for 72 test data showed good agreements with the correlation coefficient of 0.998. In addition, the predicted ECs by neural network showed relatively equal or closer to the measured ones than those by current complicated models.

  • PDF

Direct-band spread system for neural network with interference signal control (직접 대역 확산 시스템에서 신경망을 이용한 간섭 신호 제어)

  • Cho, Hyun-Seob
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.14 no.3
    • /
    • pp.1372-1377
    • /
    • 2013
  • In this Paper, a back propagation neural network learning algorithm based on the complex multilayer perceptron is represented for controling and detecting interference of the received signals in cellular mobile communication system. We proposed neural network adaptive correlator which has fast convergence rate and good performance with combining back propagation neural network and the receiver of cellular. We analyzed and proved that NNAC has lower bit error probability than that of traditional RAKE receiver through results of computer simulation in the presence of the tone and narrow-band interference and the co-channel interference.

Abnormal Vibration Diagnostics Algorithm of Rotating Machinery Using Self-Organizing Feature Map nad Learing Vector Quantization (자기조직화특징지도와 학습벡터양자화를 이용한 회전기계의 이상진동진단 알고리듬)

  • 양보석;서상윤;임동수;이수종
    • Journal of KSNVE
    • /
    • v.10 no.2
    • /
    • pp.331-337
    • /
    • 2000
  • The necessity of diagnosis of the rotating machinery which is widely used in the industry is increasing. Many research has been conducted to manipulate field vibration signal data for diagnosing the fault of designated machinery. As the pattern recognition tool of that signal, neural network which use usually back-propagation algorithm was used in the diagnosis of rotating machinery. In this paper, self-organizing feature map(SOFM) which is unsupervised learning algorithm is used in the abnormal defect diagnosis of rotating machinery and then learning vector quantization(LVQ) which is supervised learning algorithm is used to improve the quality of the classifier decision regions.

  • PDF