A Study on the Learning Efficiency of Multilayered Neural Networks using Variable Slope

기울기 조정에 의한 다층 신경회로망의 학습효율 개선방법에 대한 연구

  • 이형일 (명지대학교 대학원 컴퓨터공학과) ;
  • 남재현 (영월공업전문대학 사무자동학과) ;
  • 지선수 (원주전문대학 사무자동학과)
  • Published : 1997.05.01

Abstract

A variety of learning methods are used for neural networks. Among them, the backpropagation algorithm is most widely used in such image processing, speech recognition, and pattern recognition. Despite its popularity for these application, its main problem is associated with the running time, namely, too much time is spent for the learning. This paper suggests a method which maximize the convergence speed of the learning. Such reduction in e learning time of the backpropagation algorithm is possible through an adaptive adjusting of the slope of the activation function depending on total errors, which is named as the variable slope algorithm. Moreover experimental results using this variable slope algorithm is compared against conventional backpropagation algorithm and other variations; which shows an improvement in the performance over pervious algorithms.

Keywords