• Title/Summary/Keyword: Back-propagation

Search Result 1,463, Processing Time 0.035 seconds

A Study Of Handwritten Digit Recognition By Neural Network Trained With The Back-Propagation Algorithm Using Generalized Delta Rule (신경망 회로를 이용한 필기체 숫자 인식에 관할 연구)

  • Lee, Kye-Han;Chung, Chin-Hyun
    • Proceedings of the KIEE Conference
    • /
    • 1999.07g
    • /
    • pp.2932-2934
    • /
    • 1999
  • In this paper, a scheme for recognition of handwritten digits using a multilayer neural network trained with the back-propagation algorithm using generalized delta rule is proposed. The neural network is trained with hand written digit data of different writers and different styles. One of the purpose of the work with neural networks is the minimization of the mean square error(MSE) between actual output and desired one. The back-propagation algorithm is an efficient and very classical method. The back-propagation algorithm for training the weights in a multilayer net uses the steepest descent minimization procedure and the sigmoid threshold function. As an error rate is reduced, recognition rate is improved. Therefore we propose a method that is reduced an error rate.

  • PDF

An Weldability Estimation of Laser Welded Specimens (레이저 용접물의 용접성 평가)

  • Lee, Jeong-Ick
    • Transactions of the Korean Society of Machine Tool Engineers
    • /
    • v.16 no.1
    • /
    • pp.60-68
    • /
    • 2007
  • It has been conducted by laser vision sensor for weldability estimation of front-bead after doing high speed butt laser welding of any condition. It has been developed a real time GUI(Graphic User Interface) system for weldability application in the basis of texts and field qualify levels. In the reference of bead imperfections, defects absolute position and defects intensity index of front-bead in the basis of formability reference, it has been produced a weldability estimation and defects intensity index of back-bead by back propagation neural network. In the result of by comparing measuring data by laser vision sensor of back-bead and data by back propagation neural network of one, it has been shown the similar results. Finally, under knowledge of welding condition in production line, it has been conducted a weldability estimation of back-bead only in knowledge of informations of front-bead data without using laser vision sensor or welding inspection experts and furthermore it can be used data for final inspection results of back-bead.

Design of a systolic array for forward-backward propagation of back-propagation algorithm (역전파 알고리즘의 전방향, 역방향 동시 수행을 위한 스스톨릭 배열의 설계)

  • 장명숙;유기영
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.33B no.9
    • /
    • pp.49-61
    • /
    • 1996
  • Back-propagation(BP) algorithm needs a lot of time to train the artificial neural network (ANN) to get high accuracy level in classification tasks. So there have been extensive researches to process back-propagation algorithm on parallel processors. This paper prsents a linear systolic array which calculates forward-backward propagation of BP algorithm at the same time using effective space-time transformation and PE structure. First, we analyze data flow of forwared and backward propagations and then, represent the BP algorithm into data dapendency graph (DG) which shows parallelism inherent in the BP algorithm. Next, apply space-time transformation on the DG of ANN is turn with orthogonal direction projection. By doing so, we can get a snakelike systolic array. Also we calculate the interval of input for parallel processing, calculate the indices to make the right datas be used at the right PE when forward and bvackward propagations are processed in the same PE. And then verify the correctness of output when forward and backward propagations are executed at the same time. By doing so, the proposed system maximizes parallelism of BP algorithm, minimizes th enumber of PEs. And it reduces the execution time by 2 times through making idle PEs participate in forward-backward propagation at the same time.

  • PDF

Efficient Iris Recognition using Deep-Learning Convolution Neural Network (딥러닝 합성곱 신경망을 이용한 효율적인 홍채인식)

  • Choi, Gwang-Mi;Jeong, Yu-Jeong
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.15 no.3
    • /
    • pp.521-526
    • /
    • 2020
  • This paper presents an improved HOLP neural network that adds 25 average values to a typical HOLP neural network using 25 feature vector values as input values by applying high-order local autocorrelation function, which is excellent for extracting immutable feature values of iris images. Compared with deep learning structures with different types, we compared the recognition rate of iris recognition using Back-Propagation neural network, which shows excellent performance in voice and image field, and synthetic product neural network that integrates feature extractor and classifier.

Joint Torque Estimation of Elbow joint using Neural Network Back Propagation Theory (역전파 신경망 이론을 이용한 팔꿈치 관절의 관절토크 추정에 관한 연구)

  • Jang, Hye-Youn;Kim, Wan-Soo;Han, Jung-Soo;Han, Chang-Soo
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.28 no.6
    • /
    • pp.670-677
    • /
    • 2011
  • This study is to estimate the joint torques without torque sensor using the EMG (Electromyogram) signal of agonist/antagonist muscle with Neural Network Back Propagation Algorithm during the elbow motion. Command Signal can be guessed by EMG signal. But it cannot calculate the joint torque. There are many kinds of field utilizing Back Propagation Learning Method. It is generally used as a virtual sensor estimated physical information in the system functioning through the sensor. In this study applied the algorithm to obtain the virtual senor values estimated joint torque. During various elbow movement (Biceps isometric contraction, Biceps/Triceps Concentric Contraction (isotonic), Biceps/Triceps Concentric Contraction/Eccentric Contraction (isokinetic)), exact joint torque was measured by KINCOM equipment. It is input to the (BP)algorithm with EMG signal simultaneously and have trained in a variety of situations. As a result, Only using the EMG sensor, this study distinguished a variety of elbow motion and verified a virtual torque value which is approximately(about 90%) the same as joint torque measured by KINCOM equipment.

Evaluation for Applications of the Levenberg-Marquardt Algorithm in Geotechnical Engineering (Levenberg-Marquardt 알고리즘의 지반공학 적용성 평가)

  • Kim, Youngsu;Kim, Daeman
    • Journal of the Korean GEO-environmental Society
    • /
    • v.10 no.5
    • /
    • pp.49-57
    • /
    • 2009
  • In this study, one of the complicated geotechnical problem, compression index was predicted by a artificial neural network method of Levenberg-Marquardt (LM) algorithm. Predicted values were compared and evaluated by the results of the Back Propagation (BP) method, which is used extensively in geotechnical engineering. Also two different results were compared with experimental values estimated by verified experimental methods in order to evaluate the accuracy of each method. The results from experimental method generally showed higher error than the results of both artificial neural network method. The predicted compression index by LM algorithm showed better comprehensive results than BP algorithm in terms of convergence, but accuracy was similar each other.

  • PDF

On the set up to the Number of Hidden Node of Adaptive Back Propagation Neural Network (적응 역전파 신경회로망의 은닉 층 노드 수 설정에 관한 연구)

  • Hong, Bong-Wha
    • The Journal of Information Technology
    • /
    • v.5 no.2
    • /
    • pp.55-67
    • /
    • 2002
  • This paper presents an adaptive back propagation algorithm that update the learning parameter by the generated error, adaptively and varies the number of hidden layer node. This algorithm is expected to escaping from the local minimum and make the best environment for convergence to be change the number of hidden layer node. On the simulation tested this algorithm on two learning pattern. One was exclusive-OR learning and the other was $7{\times}5$ dot alphabetic font learning. In both examples, the probability of becoming trapped in local minimum was reduce. Furthermore, in alphabetic font learning, the neural network enhanced to learning efficient about 41.56%~58.28% for the conventional back propagation. and HNAD(Hidden Node Adding and Deleting) algorithm.

  • PDF

On the enhancement of the learning efficiency of the adaptive back propagation neural network using the generating and adding the hidden layer node (은닉층 노드의 생성추가를 이용한 적응 역전파 신경회로망의 학습능률 향상에 관한 연구)

  • Kim, Eun-Won;Hong, Bong-Wha
    • Journal of the Institute of Electronics Engineers of Korea TE
    • /
    • v.39 no.2
    • /
    • pp.66-75
    • /
    • 2002
  • This paper presents an adaptive back propagation algorithm that its able to enhancement for the learning efficiency with updating the learning parameter and varies the number of hidden layer node by the generated error, adaptively. This algorithm is expected to escaping from the local minimum and make the best environment for the convergence of the back propagation neural network. On the simulation tested this algorithm on three learning pattern. One was exclusive-OR learning and the another was 3-parity problem and 7${\times}$5 dot alphabetic font learning. In result that the probability of becoming trapped in local minimum was reduce. Furthermore, the neural network enhanced to learning efficient about 17.6%~64.7% for the existed back propagation. 

Recognition of a New Car Plate using Color Information and Error Back-propagation Neural Network Algorithms (컬러 정보와 오류역전파 신경망 알고리즘을 이용한 신차량 번호판 인식)

  • Lee, Jong-Hee;Kim, Jin-Whan
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.5 no.5
    • /
    • pp.471-476
    • /
    • 2010
  • In this paper, we propose an effective method that recognizes the vehicle license plate using RGB color information and back-propagation neural network algorithm. First, the image of the vehicle license plate is adjusted by the Mean of Blue values in the vehicle plate and two candidate areas of Red and Green region are classified by calculating the differences of pixel values and the final Green area is searched by back-propagation algorithm. Second, our method detects the area of the vehicle plate using the frequence of the horizontal and the vertical histogram. Finally, each of codes are detected by an edge detection algorithm and are recognized by error back-propagation algorithm. In order to evaluate the performance of our proposed extraction and recognition method, we have run experiments on a new car plates. Experimental results showed that the proposed license plate extraction is better than that of existing HSI information model and the overall recognition was effective.

Improving the Error Back-Propagation Algorithm for Imbalanced Data Sets

  • Oh, Sang-Hoon
    • International Journal of Contents
    • /
    • v.8 no.2
    • /
    • pp.7-12
    • /
    • 2012
  • Imbalanced data sets are difficult to be classified since most classifiers are developed based on the assumption that class distributions are well-balanced. In order to improve the error back-propagation algorithm for the classification of imbalanced data sets, a new error function is proposed. The error function controls weight-updating with regards to the classes in which the training samples are. This has the effect that samples in the minority class have a greater chance to be classified but samples in the majority class have a less chance to be classified. The proposed method is compared with the two-phase, threshold-moving, and target node methods through simulations in a mammography data set and the proposed method attains the best results.