• Title/Summary/Keyword: back-propagation learning algorithm

Search Result 386, Processing Time 0.028 seconds

The Detection of Esophagitis by Using Back Propagation Network Algorithm

  • Seo, Kwang-Wook;Min, Byeong-Ro;Lee, Dae-Weon
    • Journal of Mechanical Science and Technology
    • /
    • v.20 no.11
    • /
    • pp.1873-1880
    • /
    • 2006
  • The results of this study suggest the use of a Back Propagation Network (BPN) algorithm for the detection of esophageal erosions or abnormalities - which are the important signs of esophagitis - in the analysis of the color and textural aspects of clinical images obtained by endoscopy. The authors have investigated the optimization of the learning condition by the number of neurons in the hidden layer within the structure of the neural network. By optimizing learning parameters, we learned and have validated esophageal erosion images and/or ulcers functioning as the critical diagnostic criteria for esophagitis and associated abnormalities. Validation was established by using twenty clinical images. The success rates for detection of esophagitis during calibration and during validation were 97.91% and 96.83%, respectively.

On the Classification of Online Handwritten Digits using the Enhanced Back Propagation of Neural Networks (개선된 역전파 신경회로망을 이용한 온라인 필기체 숫자의 분류에 관한 연구)

  • Hong, Bong-Hwa
    • The Journal of Information Technology
    • /
    • v.9 no.4
    • /
    • pp.65-74
    • /
    • 2006
  • The back propagation of neural networks has the problems of falling into local minimum and delay of the speed by the iterative learning. An algorithm to solve the problem and improve the speed of the learning was already proposed in[8], which updates the learning parameter related with the connection weight. In this paper, we propose the algorithm generating initial weight to improve the efficiency of the algorithm by offering the difference between the input vector and the target signal to the generating function of initial weight. The algorithm proposed here can classify more than 98.75% of the handwritten digits and this rate shows 30% more effective than the other previous methods.

  • PDF

Rainfall Adjust and Forecasting in Seoul Using a Artificial Neural Network Technique Including a Correlation Coefficient (인공신경망기법에 상관계수를 고려한 서울 강우관측 지점 간의 강우보완 및 예측)

  • Ahn, Jeong-Whan;Jung, Hee-Sun;Park, In-Chan;Cho, Won-Cheol
    • 한국방재학회:학술대회논문집
    • /
    • 2008.02a
    • /
    • pp.101-104
    • /
    • 2008
  • In this study, rainfall adjust and forecasting using artificial neural network(ANN) which includes a correlation coefficient is application in Seoul region. It analyzed one-hour rainfall data which has been reported in 25 region in seoul during from 2000 to 2006 at rainfall observatory by AWS. The ANN learning algorithm apply for input data that each region using cross-correlation will use the highest correlation coefficient region. In addition, rainfall adjust analyzed the minimum error based on correlation coefficient and determination coefficient related to the input region. ANN model used back-propagation algorithm for learning algorithm. In case of the back-propagation algorithm, many attempts and efforts are required to find the optimum neural network structure as applied model. This is calculated similar to the observed rainfall that the correlation coefficient was 0.98 in missing rainfall adjust at 10 region. As a result, ANN model has been for suitable for rainfall adjust. It is considered that the result will be more accurate when it includes climate data affecting rainfall.

  • PDF

Robust Control of Industrial Robot Based on Back Propagation Algorithm (Back Propagation 알고리즘을 이용한 산업용 로봇의 견실 제어)

  • 윤주식;이희섭;윤대식;한성현
    • Proceedings of the Korean Society of Machine Tool Engineers Conference
    • /
    • 2004.04a
    • /
    • pp.253-257
    • /
    • 2004
  • Neural networks are works are used in the framework of sensor based tracking control of robot manipulators. They learn by practice movements the relationship between PSD(an analog Position Sensitive Detector) sensor readings for target positions and the joint commands to reach them. Using this configuration, the system can track or follow a moving or stationary object in real time. Furthermore, an efficient neural network architecture has been developed for real time learning. This network uses multiple sets of simple back propagation networks one of which is selected according to which division(corresponding to a cluster of the self-organizing feature map) in data space the current input data belongs to. This lends itself to a very training and processing implementation required for real time control.

  • PDF

Modified Error Back Propagation Algorithm using the Approximating of the Hidden Nodes in Multi-Layer Perceptron (다층퍼셉트론의 은닉노드 근사화를 이용한 개선된 오류역전파 학습)

  • Kwak, Young-Tae;Lee, young-Gik;Kwon, Oh-Seok
    • Journal of KIISE:Software and Applications
    • /
    • v.28 no.9
    • /
    • pp.603-611
    • /
    • 2001
  • This paper proposes a novel fast layer-by-layer algorithm that has better generalization capability. In the proposed algorithm, the weights of the hidden layer are updated by the target vector of the hidden layer obtained by least squares method. The proposed algorithm improves the learning speed that can occur due to the small magnitude of the gradient vector in the hidden layer. This algorithm was tested in a handwritten digits recognition problem. The learning speed of the proposed algorithm was faster than those of error back propagation algorithm and modified error function algorithm, and similar to those of Ooyen's method and layer-by-layer algorithm. Moreover, the simulation results showed that the proposed algorithm had the best generalization capability among them regardless of the number of hidden nodes. The proposed algorithm has the advantages of the learning speed of layer-by-layer algorithm and the generalization capability of error back propagation algorithm and modified error function algorithm.

  • PDF

Implementation of Speed-Sensorless Induction Motor Drives with RLS Algorithm (RLS 알로리즘을 이용한 유도전동기의 속도 센서리스 운전)

  • 김윤호;국윤상
    • Proceedings of the KIPE Conference
    • /
    • 1998.07a
    • /
    • pp.384-387
    • /
    • 1998
  • This paper presents a newly developed speed sensorless drive using RLS(Recursive Least Squares) based on Neural Network Training Algorithm. The proposed algorithm based on the RLS has just the time-varying learning rate, while the well-known back-propagation (or generalized delta rule) algorithm based on gradient descent has a constant learning rate. The number of iterations required by the new algorithm to converge is less than that of the back-propagation algorithm. The RLS based on NN is used to adjust the motor speed so that the neural model output follows the desired trajectory. This mechanism forces the estimated speed to follow precisely the actual motor speed. In this paper, a flux estimation strategy using filter concept is discussed. The theoretical analysis and experimental results to verify the effectiveness of the proposed analysis and the proposed control strategy are described.

  • PDF

A study on nonlinear data-based modeling using fuzzy neural networks (퍼지신경망을 이용한 비선형 데이터 모델링에 관한 연구)

  • Kwon, Oh-Gook;Jang, Wook;Joo, Young-Hoon;Choi, Yoon-Ho;Park, Jin-Bae
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.120-123
    • /
    • 1997
  • This paper presents models of fuzzy inference systems that can be built from a set of input-output training data pairs through hybrid structure-parameter learning. Fuzzy inference systems has the difficulty of parameter learning. Here we develop a coding format to determine a fuzzy neural network(FNN) model by chromosome in a genetic algorithm(GA) and present systematic approach to identify the parameters and structure of FNN. The proposed FNN can automatically identify the fuzzy rules and tune the membership functions by modifying the connection weights of the networks using the GA and the back-propagation learning algorithm. In order to show effectiveness of it we simulate and compare with conventional methods.

  • PDF

Improved Error Backpropagation Algorithm using Modified Activation Function Derivative (수정된 Activation Function Derivative를 이용한 오류 역전파 알고리즘의 개선)

  • 권희용;황희영
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.41 no.3
    • /
    • pp.274-280
    • /
    • 1992
  • In this paper, an Improved Error Back Propagation Algorithm is introduced, which avoids Network Paralysis, one of the problems of the Error Backpropagation learning rule. For this purpose, we analyzed the reason for Network Paralysis and modified the Activation Function Derivative of the standard Error Backpropagation Algorithm which is regarded as the cause of the phenomenon. The characteristics of the modified Activation Function Derivative is analyzed. The performance of the modified Error Backpropagation Algorithm is shown to be better than that of the standard Error Back Propagation algorithm by various experiments.

  • PDF

A Modified Error Function to Improve the Error Back-Propagation Algorithm for Multi-Layer Perceptrons

  • Oh, Sang-Hoon;Lee, Young-Jik
    • ETRI Journal
    • /
    • v.17 no.1
    • /
    • pp.11-22
    • /
    • 1995
  • This paper proposes a modified error function to improve the error back-propagation (EBP) algorithm for multi-Layer perceptrons (MLPs) which suffers from slow learning speed. It can also suppress over-specialization for training patterns that occurs in an algorithm based on a cross-entropy cost function which markedly reduces learning time. In the similar way as the cross-entropy function, our new function accelerates the learning speed of the EBP algorithm by allowing the output node of the MLP to generate a strong error signal when the output node is far from the desired value. Moreover, it prevents the overspecialization of learning for training patterns by letting the output node, whose value is close to the desired value, generate a weak error signal. In a simulation study to classify handwritten digits in the CEDAR [1] database, the proposed method attained 100% correct classification for the training patterns after only 50 sweeps of learning, while the original EBP attained only 98.8% after 500 sweeps. Also, our method shows mean-squared error of 0.627 for the test patterns, which is superior to the error 0.667 in the cross-entropy method. These results demonstrate that our new method excels others in learning speed as well as in generalization.

  • PDF

Orientation Control of Mobile Robot Using Fuzzy-Neural Control Technique (퍼지-뉴럴 제어기법에 의한 이동형 로봇의 자세 제어)

  • 김종수
    • Proceedings of the Korean Society of Machine Tool Engineers Conference
    • /
    • 1997.10a
    • /
    • pp.82-87
    • /
    • 1997
  • This paper presents a new approach to the design of cruise control system of a mobile robot with two drive wheel. The proposed control scheme uses a Gaussian function as a unit function in the fuzzy-neural network, and back propagation algorithm to train the fuzzy-neural network controller in the framework of the specialized learning architecture. It is proposed a learning controller consisting of two neural network-fuzzy based on independent reasoning and a connection net with fixed weights to simply the neural networks-fuzzy. The performance of the proposed controller is shown by performing the computer simulation for trajectory tracking of the speed and azimuth of a mobile robot driven by two independent wheels.

  • PDF