• 제목/요약/키워드: Back propagation rule

검색결과 94건 처리시간 0.027초

신경망 회로를 이용한 필기체 숫자 인식에 관할 연구 (A Study Of Handwritten Digit Recognition By Neural Network Trained With The Back-Propagation Algorithm Using Generalized Delta Rule)

  • 이규한;정진현
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 1999년도 하계학술대회 논문집 G
    • /
    • pp.2932-2934
    • /
    • 1999
  • In this paper, a scheme for recognition of handwritten digits using a multilayer neural network trained with the back-propagation algorithm using generalized delta rule is proposed. The neural network is trained with hand written digit data of different writers and different styles. One of the purpose of the work with neural networks is the minimization of the mean square error(MSE) between actual output and desired one. The back-propagation algorithm is an efficient and very classical method. The back-propagation algorithm for training the weights in a multilayer net uses the steepest descent minimization procedure and the sigmoid threshold function. As an error rate is reduced, recognition rate is improved. Therefore we propose a method that is reduced an error rate.

  • PDF

혼합형 학습규칙 신경 회로망을 이용한 제어 방식 (Control Method using Neural Network of Hybrid Learning Rule)

  • 임중규;이현관;권성훈;엄기환
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국해양정보통신학회 1999년도 춘계종합학술대회
    • /
    • pp.370-374
    • /
    • 1999
  • 본 논문에서는 역전파 알고리즘과 헵 학습규칙의 장점을 최대한 살려 이용하고, 역전파 알고리즘의 문제점인 지역 최소점에 빠지는 경우와 학습시간이 느린 단점과 헵 학습규칙의 문제점인 학습 패턴의 저장능력이 매우 제한되고 선형적 분리가 되지 않는 복잡한 문제에는 적용할 수 없다는 단점등을 개선하기 위하여 혼합형 학습규칙을 제안한다. 제안하는 학습규칙은 입력층과 은닉층에 흔합형 학습규칙과 은닉층과 출력층에 역전파(Back-Propagation) 학습규칙을 적용한 혼합형이다. 제안한 혼합형 학습규칙을 이용한 신경회로망의 유용성을 확인하기 위하여 단일관절 매니플레이터를 이용하여 추종제어에 대한 시뮬레이션을 하여 기존의 역전파 알고리즘을 이용한 직접적응 제어 방식과 제어성능을 비교 검토한 결과 다음과 같은 특성을 확인하였다.

  • PDF

역전달 신경회로망을 이용한 심전도 파형의 부정맥 분류 (Classification of ECG Arrhythmia Signals Using Back-Propagation Network)

  • 권오철;최진영
    • 대한의용생체공학회:의공학회지
    • /
    • 제10권3호
    • /
    • pp.343-350
    • /
    • 1989
  • A new algorithm classifying ECG Arrhythmia signals using Back-propagation network is proposed. The base-line of ECG signal is detected by high pass filter and probability density function then input data are normalized for learning and classifying. In addition, ECG data are scanned to classify Arrhythmia signal which is hard to find R-wave. A two-layer perceptron with one hidden layer along with error back-propagation learning rule is utilized as an artificial neural network. The proposed algorithm shows outstanding performance under circumstances of amplitude variation, baseline wander and noise contamination.

  • PDF

점진적 학습영역 확장에 의한 다층인식자의 학습능력 향상 (Improvement of Learning Capabilities in Multilayer Perceptron by Progressively Enlarging the Learning Domain)

  • 최종호;신성식;최진영
    • 전자공학회논문지B
    • /
    • 제29B권1호
    • /
    • pp.94-101
    • /
    • 1992
  • The multilayer perceptron, trained by the error back-propagation learning rule, has been known as a mapping network which can represent arbitrary functions. However depending on the complexity of a function and the initial weights of the multilayer perceptron, the error back-propagation learning may fall into a local minimum or a flat area which may require a long learning time or lead to unsuccessful learning. To solve such difficulties in training the multilayer perceptron by standard error back-propagation learning rule, the paper proposes a learning method which progressively enlarges the learning domain from a small area to the entire region. The proposed method is devised from the investigation on the roles of hidden nodes and connection weights in the multilayer perceptron which approximates a function of one variable. The validity of the proposed method was illustrated through simulations for a function of one variable and a function of two variable with many extremal points.

  • PDF

오류 역전파법으로구현한 컬러 인쇄물 검사에 관한 연구 (A study on the realization of color printed material check using Error Back-Propagation rule)

  • 한희석;이규영
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 1998년도 추계학술대회 학술발표 논문집
    • /
    • pp.560-567
    • /
    • 1998
  • This paper concerned about a imputed color printed material image in camera to decrease noise and distortion by processing median filtering with input image to identical condition. Also this paper proposed the way of compares a normal printed material with an abnormal printed material color tone with trained a learning of the error back-propagation to block classification by extracting five place from identical block(3${\times}$3) of color printed material R, G, B value. As a representative algorithm of multi-layer perceptron the error Back-propagation technique used to solve complex problems. However, the Error Back-propagation is algorithm which basically used a gradient descent method which can be converged to local minimum and the Back Propagation train include problems, and that may converge in a local minimum rather than get a global minimum. The network structure appropriate for a given problem. In this paper, a good result is obtained by improve initial condition and adjust th number of hidden layer to solve the problem of real time process, learning and train.

  • PDF

신경회로망을 이용한 수도 증발산량 예측 -백프로파게이션과 카운터프로파게이션 알고리즘의 적용- (Estimating Evapotranspiration of Rice Crop Using Neural Networks -Application of Back-propagation and Counter-propagation Algorithm-)

  • 이남호;정하우
    • 한국농공학회지
    • /
    • 제36권2호
    • /
    • pp.88-95
    • /
    • 1994
  • This paper is to evaluate the applicability of neural networks to the estimation of evapotranspiration. Two neural networks were developed to forecast daily evapotranspiration of the rice crop with back-propagation and counter-propagation algorithm. The neural network trained by back-propagation algorithm with delta learning rule is a three-layer network with input, hidden, and output layers. The other network with counter-propagation algorithm is a four-layer network with input, normalizing, competitive, and output layers. Training neural networks was conducted using daily actual evapotranspiration of rice crop and daily climatic data such as mean temperature, sunshine hours, solar radiation, relative humidity, and pan evaporation. During the training, neural network parameters were calibrated. The trained networks were applied to a set of field data not used in the training. The created response of the back-propagation network was in good agreement with desired values and showed better performances than the counter-propagation network did. Evaluating the neural network performance indicates that the back-propagation neural network may be applied to the estimation of evapotranspiration of the rice crop. This study does not provide with a conclusive statement as to the ability of a neural network to evapotranspiration estimating. More detailed study is required for better understanding and evaluating the behavior of neural networks.

  • PDF

A Study on the Neuro-Fuzzy Control and Its Application

  • So, Myung-Ok;Yoo, Heui-Han;Jin, Sun-Ho
    • Journal of Advanced Marine Engineering and Technology
    • /
    • 제28권2호
    • /
    • pp.228-236
    • /
    • 2004
  • In this paper. we present a neuro-fuzzy controller which unifies both fuzzy logic and multi-layered feed forward neural networks. Fuzzy logic provides a means for converting linguistic control knowledge into control actions. On the other hand. feed forward neural networks provide salient features. such as learning and parallelism. In the proposed neuro-fuzzy controller. the parameters of membership functions in the antecedent part of fuzzy inference rules are identified by using the error back propagation algorithm as a learning rule. while the coefficients of the linear combination of input variables in the consequent part are determined by using the least square estimation method. Finally. the effectiveness of the proposed controller is verified through computer simulation for an inverted pole system.

학습기능을 갖는 자동 규칙 생성 퍼지 신경망 (Fuzzy Neural Network with Rule Generaton Nased on Back-Propagation Algorithm)

  • 정재경;이동윤;정기욱;김완찬
    • 전자공학회논문지B
    • /
    • 제33B권4호
    • /
    • pp.191-200
    • /
    • 1996
  • This paper presetns a new fuzzy neural network for fuzzy modeling.The fuzzy neural network is composed of 4 layers and then odes of each layer represent the each step of the if-then fuzzy inference. A heuristic based on the back-propagation algorithm is proposed to ajdust the parameters of the fuzzy nerual network. We prove the feasibility of the network using the experiments on modeling a nonlinear mathematical system and the comparison with previous research.

  • PDF

신경회로망을 이용한 퍼지룰의 추론과 학습에 관한 연구 (A Study on Reasoning and Learning of Fuzzy Rules Using Neural Networks)

  • 이계호;임영철;김이곤;조경영
    • 한국통신학회논문지
    • /
    • 제18권2호
    • /
    • pp.231-238
    • /
    • 1993
  • 퍼지제어룰은 일반적으로 시스템에 대한 전문오퍼레이터나 기술자가 갖고 있는 애매모호함을 포함하고 있는 제어지식을 시스템의 입 출력 분할에 의해 if-then이라는 언어적 룰로서 표현하는 것으로 전문오퍼레이터나 기술자의 제어지식 자체의 부정확과 룰의 불완전등으로 완전하게 표현한다는 것은 대단히 어렵다. 이러한 불완전한 룰의 정확도를 시스템 동작 후에도 연속적으로 높이기 위한 방법으로서 신경회로망에 의한 퍼지 추론과 학습을 제시한다. 이 방식은 시스템의 퍼지롤의 후건부를 층상신경회로망의 역전파(Back-propagation) 학습방법에 의한 정확도를 증진시키고, 전건부의 적합도를 연상기억방식에 의해 추론하는 방식으로서, 이 방식을 이용하여 한정된 구역 내에서 숙련된 기술과 지식이 필요한 차의 안전하고 신속한 정차를 위한 Auto-Parking Fuzzy Controller를 설계하고 시뮬레이션을 통해 그 타당성을 입증하였다.

  • PDF

Application of Neural Networks For Estimating Evapotranspiration

  • Lee, Nam-Ho
    • 한국농업기계학회:학술대회논문집
    • /
    • 한국농업기계학회 1993년도 Proceedings of International Conference for Agricultural Machinery and Process Engineering
    • /
    • pp.1273-1281
    • /
    • 1993
  • Estimation of daily and seasonal evaportranspiration is essential for water resource planning irrigation feasibility study, and real-time irrigation water management . This paper is to evaluate the applicability of neural networks to the estimation of evapotranspiration . A neural network was developed to forecast daily evapotranspiration of the rice crop. It is a three-layer network with input, hidden , and output layers. Back-propagation algorithm with delta learning rule was used to train the neural network. Training neural network wasconducted usign daily actural evapotranspiration of rice crop and daily climatic data such as mean temperature, sunshine hours, solar radiation, relative humidity , and pan evaporation . During the training, neural network parameters were calibrated. The trained network was applied to a set of field data not used in the training . The created response of the neural network was in good agreement with desired values. Evaluating the neural networ performance indicates that neural network may be applied to the estimation of evapotranspiration of the rice crop.

  • PDF