• Title/Summary/Keyword: backpropagation method

Search Result 262, Processing Time 0.029 seconds

Improved Error Backpropagation by Elastic Learning Rate and Online Update (가변학습율과 온라인모드를 이용한 개선된 EBP 알고리즘)

  • Lee, Tae-Seung;Park, Ho-Jin
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2004.04b
    • /
    • pp.568-570
    • /
    • 2004
  • The error-backpropagation (EBP) algerithm for training multilayer perceptrons (MLPs) is known to have good features of robustness and economical efficiency. However, the algorithm has difficulty in selecting an optimal constant learning rate and thus results in non-optimal learning speed and inflexible operation for working data. This paper Introduces an elastic learning rate that guarantees convergence of learning and its local realization by online upoate of MLP parameters Into the original EBP algorithm in order to complement the non-optimality. The results of experiments on a speaker verification system with Korean speech database are presented and discussed to demonstrate the performance improvement of the proposed method in terms of learning speed and flexibility fer working data of the original EBP algorithm.

  • PDF

A Performance Comparison of Backpropagation Neural Networks and Learning Vector Quantization Techniques for Sundanese Characters Recognition

  • Haviluddin;Herman Santoso Pakpahan;Dinda Izmya Nurpadillah;Hario Jati Setyadi;Arif Harjanto;Rayner Alfred
    • International Journal of Computer Science & Network Security
    • /
    • v.24 no.3
    • /
    • pp.101-106
    • /
    • 2024
  • This article aims to compare the accuracy of the Backpropagation Neural Network (BPNN) and Learning Vector Quantization (LVQ) approaches in recognizing Sundanese characters. Based on experiments, the level of accuracy that has been obtained by the BPNN technique is 95.23% and the LVQ technique is 66.66%. Meanwhile, the learning time that has been required by the BPNN technique is 2 minutes 45 seconds and then the LVQ method is 17 minutes 22 seconds. The results indicated that the BPNN technique was better than the LVQ technique in recognizing Sundanese characters in accuracy and learning time.

Lateral Control of Vision-Based Autonomous Vehicle using Neural Network (신형회로망을 이용한 비젼기반 자율주행차량의 횡방향제어)

  • 김영주;이경백;김영배
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2000.11a
    • /
    • pp.687-690
    • /
    • 2000
  • Lately, many studies have been progressed for the protection human's lives and property as holding in check accidents happened by human's carelessness or mistakes. One part of these is the development of an autonomouse vehicle. General control method of vision-based autonomous vehicle system is to determine the navigation direction by analyzing lane images from a camera, and to navigate using proper control algorithm. In this paper, characteristic points are abstracted from lane images using lane recognition algorithm with sobel operator. And then the vehicle is controlled using two proposed auto-steering algorithms. Two steering control algorithms are introduced in this paper. First method is to use the geometric relation of a camera. After transforming from an image coordinate to a vehicle coordinate, a steering angle is calculated using Ackermann angle. Second one is using a neural network algorithm. It doesn't need to use the geometric relation of a camera and is easy to apply a steering algorithm. In addition, It is a nearest algorithm for the driving style of human driver. Proposed controller is a multilayer neural network using Levenberg-Marquardt backpropagation learning algorithm which was estimated much better than other methods, i.e. Conjugate Gradient or Gradient Decent ones.

  • PDF

Detection of ST-T Episode Based on the Global Curvature of Isoelectric Level in ECG (ECG 신호의 global curvature를 이용한 ST-T 에피소드 검출)

  • Kang, Dong-Won;Jun, Dae-Gun;Lee, Kyoung-Joung;Yoon, Hyung-Ro
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.50 no.4
    • /
    • pp.201-207
    • /
    • 2001
  • This paper describes an automated detection algorithm of ST-T episodes using global curvature which can connect the isoelectric level in ECG and can eliminate not only the slope of ST segment, but also difference of the baseline and global curve. This above method of baseline correction is very faster than the classical baseline correction methods. The optimal values of parameters for baseline correction were found as the value having the highest detection rate of ST episode. The features as input of backpropagation Neural Network were extracted from the whole ST segment. The European ST-T database was used as training and test data. Finally, ST elevation, ST depression and normal ST were classified. The average ST episode sensitivity and predictivity were 85.42%, 80.29%, respectively. This result shows the high speed and reliability in ST episode detection. In conclusion, the proposed method showed the possibility in various applications for the Holter system.

  • PDF

A Method on the Learning Speed Improvement of the Online Error Backpropagation Algorithm in Speech Processing (음성처리에서 온라인 오류역전파 알고리즘의 학습속도 향상방법)

  • 이태승;이백영;황병원
    • The Journal of the Acoustical Society of Korea
    • /
    • v.21 no.5
    • /
    • pp.430-437
    • /
    • 2002
  • Having a variety of good characteristics against other pattern recognition techniques, the multilayer perceptron (MLP) has been widely used in speech recognition and speaker recognition. But, it is known that the error backpropagation (EBP) algorithm that MLP uses in learning has the defect that requires restricts long learning time, and it restricts severely the applications like speaker recognition and speaker adaptation requiring real time processing. Because the learning data for pattern recognition contain high redundancy, in order to increase the learning speed it is very effective to use the online-based learning methods, which update the weight vector of the MLP by the pattern. A typical online EBP algorithm applies the fixed learning rate for each update of the weight vector. Though a large amount of speedup with the online EBP can be obtained by choosing the appropriate fixed rate, firing the rate leads to the problem that the algorithm cannot respond effectively to different learning phases as the phases change and the number of patterns contributing to learning decreases. To solve this problem, this paper proposes a Changing rate and Omitting patterns in Instant Learning (COIL) method to apply the variable rate and the only patterns necessary to the learning phase when the phases come to change. In this paper, experimentations are conducted for speaker verification and speech recognition, and results are presented to verify the performance of the COIL.

Identification of the Chip Form Using Back Propagation Algorithm (백프로파게이션 알고리즘을 이용한 칩 형태의 인식)

  • 심재형;권혁준;백인환
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 1996.11a
    • /
    • pp.206-211
    • /
    • 1996
  • A major problem in automation of turning operation is the difficulty in obtaining a sufficient and reliable chip control. Therefore it becomes desirable to find a method which can detect the chip form. In this paper, a method of the identification of chip form using output of pyrometer and neural network technique is developed. An efficiency of developed method is examined by experiments in turning and the validity of it is confirmed.

  • PDF

Local-step Optimization in Online Update Learning of Multilayer Perceptrons (다충신경망을 위한 온라인방식 학습의 개별학습단계 최적화 방법)

  • Tae-Seung, Lee;Ho-Jin, Choi
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2004.10b
    • /
    • pp.700-702
    • /
    • 2004
  • A local-step optimization method is proposed to supplement the global-step optimization methods which adopt online update mode of internal weights and error energy as stop criterion in learning of multilayer perceptrons (MLPs). This optimization method is applied to the standard online error backpropagation(EBP) and the performance is evaluated for a speaker verification system.

  • PDF

Recognition of Partial Discharge Patterns using Classifiers and the Neural Network (신경회로망과 Classifier를 이용한 부분방전패턴의 인식)

  • 이준호;이진우
    • Proceedings of the Korean Institute of IIIuminating and Electrical Installation Engineers Conference
    • /
    • 1999.11a
    • /
    • pp.132-135
    • /
    • 1999
  • In this work, two approaches were proposed for the recognition of partial discharge patterns. The first approach was neural network with backpropagation algorithm, and the second approach was angle calculation between two operator vectors. PD signal were detected using three electrode systems; IEC(b), needle-plane and CIGRE method II electrode system. Both of neural network and angle comparison method showed good recognition performance for the patte군 similar to the trained patterns. And the number of operators to be used had a great influence on the recognition performance to the untrained patterns.

  • PDF

Speed-Sensorless Vector Control of an Induction Motor Using Neural Network (신경망을 이용한 유도 전동기의 센서리스 속도제어)

  • Kim, Jung-Gon;Park, Seong-Wook;Seo, Bo-Hyeok
    • Proceedings of the KIEE Conference
    • /
    • 2002.07d
    • /
    • pp.2149-2151
    • /
    • 2002
  • In this paper, a novel speed estimation method of an induction motor using neural networks(NNs) is presented. The NN speed estimator is trained online by using the error backpropagation algorithm, and the training starts simultaneously with the induction motor working. The neural network based vector controller has the advantage of robustness against machine parameter variation. The simulation results using Matlab/Simulink verify the useful of the proposed method.

  • PDF

Computer-Aided Detection of Clustered Microcalcifications using Texture Analysis and Neural Network in Digitized X-ray Mammograms (X-선 유방영상에서 텍스처 분석과 신경망을 이용한 군집성 미세석회화의 컴퓨터 보조검출)

  • 김종국;박정미
    • Journal of Biomedical Engineering Research
    • /
    • v.19 no.1
    • /
    • pp.1-8
    • /
    • 1998
  • Clustered microcalcifications on X-ray mammograms are an important sign for early detection of breast cancer. This paper proposes a computer-aided diagnosis method for the detection of clustered microcalcifications and marking their locations on digitized mammograms. The proposed detection method consists of the region of interest (ROI) selection, the film-artifact removal, the surrounding texture analysis method for the detection of clustered microcalcifications, which is based on the second-order histogram in two nested surrounding regions on the current pixel. This paper also describes the effectiveness of the proposed film-artifact removal filter in terms of the classification performance with the receiver operating-characteristics(ROC) analysis. A three-layer backpropagation neural network is employed as a classifier. The appropriate marking for the locations of clustered microcalcifications can be used to alert radiologists to locations of suspicious lesions.

  • PDF