• 제목/요약/키워드: back-propagation method

검색결과 648건 처리시간 0.036초

역전파 알고리즘을 이용한 경계결정의 구성에 관한 연구 (The Structure of Boundary Decision Using the Back Propagation Algorithms)

  • 이지영
    • 정보학연구
    • /
    • 제8권1호
    • /
    • pp.51-56
    • /
    • 2005
  • The Back propagation algorithm is a very effective supervised training method for multi-layer feed forward neural networks. This paper studies the decision boundary formation based on the Back propagation algorithm. The discriminating powers of several neural network topology are also investigated against five manually created data sets. It is found that neural networks with multiple hidden layer perform better than single hidden layer.

  • PDF

잡음 영상에서 불균등 돌연변이 연산자를 이용한 효율적 에지 검출 (Edge detection method using unbalanced mutation operator in noise image)

  • 김수정;임희경;서요한;정채영
    • 정보처리학회논문지B
    • /
    • 제9B권5호
    • /
    • pp.673-680
    • /
    • 2002
  • 이 논문은 진화 프로그래밍과 개선된 역전파 알고리즘을 이용한 에지 검출 방법을 제안한다. 진화 프로그래밍은 알고리즘의 성능저하와 계산비용을 고려하여 교차 연산은 수행하지 않고, 선택연산자와 돌연변이 연산자를 사용한다. 개선된 역전파 알고리즘은 학습단계에서 연결강도를 변화시킬 때 이전학습단계의 연결강도를 보조적으로 활용하는 방법이다. 이 개선된 역전파 알고리즘은 학습률 $\alpha$를 작은값으로 설정하기 때문에 각 학습단계에서의 연결강도 변화량이 기존의 방법에 비해 상대적으로 줄어들게 되어 학습이 느려지는 문제점을 해결하였다. 실험결과 학습시간과 검출률에 있어서 GA-BP(GA : Genetic Algorithm BP : Back-Propagation)를 이용한 방법보다 제안한 EP-MBP(EP : Evolutionary Programming, MBP :Momentum Back-Propagation)를 이용하여 학습시킨 방법이 학습시간의 단축과 효율적인 에지 검출 결과를 얻을 수 있었다.

초타원 가우시안 소속함수를 사용한 퍼지신경망 모델링 (Fuzzy neural network modeling using hyper elliptic gaussian membership functions)

  • 권오국;주영훈;박진배
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1997년도 한국자동제어학술회의논문집; 한국전력공사 서울연수원; 17-18 Oct. 1997
    • /
    • pp.442-445
    • /
    • 1997
  • We present a hybrid self-tuning method of fuzzy inference systems with hyper elliptic Gaussian membership functions using genetic algorithm(GA) and back-propagation algorithm. The proposed self-tuning method has two phases : one is the coarse tuning process based on GA and the other is the fine tuning process based on back-propagation. But the parameters which is obtained by a GA are near optimal solutions. In order to solve the problem in GA applications, it uses a back-propagation algorithm, which is one of learning algorithms in neural networks, to finely tune the parameters obtained by a GA. We provide Box-Jenkins time series to evaluate the advantage and effectiveness of the proposed approach and compare with the conventional method.

  • PDF

역전파 ANN을 위한 고정 크기 시스톨릭 어레이 설계 (Design of the Fixed Size Systolic Array for the Back-propagation ANN)

  • 김지연;장명숙;박기현
    • 한국정보과학회:학술대회논문집
    • /
    • 한국정보과학회 1998년도 가을 학술발표논문집 Vol.25 No.2 (3)
    • /
    • pp.691-693
    • /
    • 1998
  • A parallel processing systolic array reduces execution time of the Back-propagation ANN. But, systolic array must be designed whenever the number of neurons in the ANN differ. To use the systolic array which is aready designed ad a fixed size VLSI chip, partition of the problem size systolic array must be performed. This paper presents a design method of the fixed size systolic array for the Back-propagation algorthm using LSGP and LPGS partion method

  • PDF

지진원 영상화를 위한 엇갈린 격자 유한 차분법을 이용한 지진파 역행 전파 모의 (Imaging of seismic sources by time-reversed wave propagation with staggered-grid finite-difference method)

  • 신동훈;황의홍;류용규;윤용훈
    • 한국지진공학회:학술대회논문집
    • /
    • 한국지진공학회 2006년도 학술발표회 논문집
    • /
    • pp.25-32
    • /
    • 2006
  • We present a imaging method of seismic sources by time reversal propagation of seismic waves. Time-reversal wave propagation is actively used in medical imaging, non destructive testing and waveform tomography. Time-reversal wave propagation is based on the time-reversal invariance and the spatial reciprocity of the wave equation. A signal is recorded by an array of receivers, time-reversed and then back-propagated into the medium. The time-reversed signal propagates back into the same medium and the energy refocuses back at the source location. The increasing power of computers and numerical methods makes it possible to simulate more accurately the propagation of seismic waves in heterogenous media. In this work, a staggered-grid finite-difference solution of the elastic wave equation is employed for the wave propagation simulation. With numerical experiments, we show that the time-reversal imaging will enable us to explore the spatio-temporal history of complex earthquake.

  • PDF

오류 역전파법으로구현한 컬러 인쇄물 검사에 관한 연구 (A study on the realization of color printed material check using Error Back-Propagation rule)

  • 한희석;이규영
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 1998년도 추계학술대회 학술발표 논문집
    • /
    • pp.560-567
    • /
    • 1998
  • This paper concerned about a imputed color printed material image in camera to decrease noise and distortion by processing median filtering with input image to identical condition. Also this paper proposed the way of compares a normal printed material with an abnormal printed material color tone with trained a learning of the error back-propagation to block classification by extracting five place from identical block(3${\times}$3) of color printed material R, G, B value. As a representative algorithm of multi-layer perceptron the error Back-propagation technique used to solve complex problems. However, the Error Back-propagation is algorithm which basically used a gradient descent method which can be converged to local minimum and the Back Propagation train include problems, and that may converge in a local minimum rather than get a global minimum. The network structure appropriate for a given problem. In this paper, a good result is obtained by improve initial condition and adjust th number of hidden layer to solve the problem of real time process, learning and train.

  • PDF

신경망 회로를 이용한 필기체 숫자 인식에 관할 연구 (A Study Of Handwritten Digit Recognition By Neural Network Trained With The Back-Propagation Algorithm Using Generalized Delta Rule)

  • 이규한;정진현
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 1999년도 하계학술대회 논문집 G
    • /
    • pp.2932-2934
    • /
    • 1999
  • In this paper, a scheme for recognition of handwritten digits using a multilayer neural network trained with the back-propagation algorithm using generalized delta rule is proposed. The neural network is trained with hand written digit data of different writers and different styles. One of the purpose of the work with neural networks is the minimization of the mean square error(MSE) between actual output and desired one. The back-propagation algorithm is an efficient and very classical method. The back-propagation algorithm for training the weights in a multilayer net uses the steepest descent minimization procedure and the sigmoid threshold function. As an error rate is reduced, recognition rate is improved. Therefore we propose a method that is reduced an error rate.

  • PDF

Levenberg-Marquardt 알고리즘의 지반공학 적용성 평가 (Evaluation for Applications of the Levenberg-Marquardt Algorithm in Geotechnical Engineering)

  • 김영수;김대만
    • 한국지반환경공학회 논문집
    • /
    • 제10권5호
    • /
    • pp.49-57
    • /
    • 2009
  • 본 연구에서는 Levenberg-Marquardt(LM) 알고리즘 인공신경망을 통하여 지반공학 문제 중의 하나인 압축지수를 예측하였고, 예측된 결과는 현재 지반공학에 널리 사용되고 있는 Back Propagation(BP) 알고리즘 인공신경망의 예측 결과와 비교하여 LM 알고리즘의 지반공학 적용성을 평가하였다. 또한 두 알고리즘에 의한 예측치는 기존에 제안된 압축지수의 경험식들에 의하여 산정된 결과들과 비교를 통하여 예측결과의 정확성을 확인하였다. 경험식에 의한 압축지수의 산정치는 전반적으로 BP 알고리즘과 LM 알고리즘 인공신경망에 의한 예측치에 비하여 더 큰 오차를 나타냈다. LM 알고리즘에 의한 압축지수의 예측치는 BP 알고리즘의 예측치와 비교할 때 정확도는 비슷하나 수렴속도에서 더 좋은 결과를 보여 LM 알고리즘의 지반공학 적용성은 우수한 것으로 나타났다.

  • PDF

Back-Propagation방법의 수렴속도 및 학습정확도의 개선 (Acceleration the Convergence and Improving the Learning Accuracy of the Back-Propagation Method)

  • 이윤섭;우광방
    • 대한전기학회논문지
    • /
    • 제39권8호
    • /
    • pp.856-867
    • /
    • 1990
  • In this paper, the convergence and the learning accuracy of the back-propagation (BP) method in neural network are investigated by 1) analyzing the reason for decelerating the convergence of BP method and examining the rapid deceleration of the convergence when the learning is executed on the part of sigmoid activation function with the very small first derivative and 2) proposing the modified logistic activation function by defining, the convergence factor based on the analysis. Learning on the output patterns of binary as well as analog forms are tested by the proposed method. In binary output patter, the test results show that the convergence is accelerated and the learning accuracy is improved, and the weights and thresholds are converged so that the stability of neural network can be enhanced. In analog output patter, the results show that with extensive initial transient phenomena the learning error is decreased according to the convergence factor, subsequently the learning accuracy is enhanced.

  • PDF

Random Tabu 탐색법을 이용한 신경회로망의 고속학습알고리즘에 관한 연구 (Fast Learning Algorithms for Neural Network Using Tabu Search Method with Random Moves)

  • 양보석;신광재;최원호
    • 한국지능시스템학회논문지
    • /
    • 제5권3호
    • /
    • pp.83-91
    • /
    • 1995
  • 본 연구에서는 종래에 학습법으로 널리 이용되고 있는 역전파학습법의 문제점으로 지적되어 온 학습에 많은 시간이 걸리는 점과 국소적 최적해에 해가 수렴하여 오차가 충분히 작게 되지 않는 등의 문제점을 해결하기 위해, Hu에 의해 고안된 random tabu 탐색법을 이용하여 신경회로망의 연결강도를 최적화하는 학습알고리즘을 새로이 제안하였다. 그리고 이 방법을 배타적 논리합 문제에 적용하여 기존의 역전파학습법과 학습상수 $, $에 tabu탐색법을 이용한 결과와 비교 검토하여 본 방법이 국소적 최적해에 수렴하지 않고 수렴정도를 개선할 수 있음을 확인하였다.

  • PDF