수정된 Activation Function Derivative를 이용한 오류 역전파 알고리즘의 개선

Improved Error Backpropagation Algorithm using Modified Activation Function Derivative

  • 권희용 (서울대 대학원 컴퓨터공학과) ;
  • 황희영 (서울대 공대 컴퓨터공학과)
  • 발행 : 1992.03.01

초록

In this paper, an Improved Error Back Propagation Algorithm is introduced, which avoids Network Paralysis, one of the problems of the Error Backpropagation learning rule. For this purpose, we analyzed the reason for Network Paralysis and modified the Activation Function Derivative of the standard Error Backpropagation Algorithm which is regarded as the cause of the phenomenon. The characteristics of the modified Activation Function Derivative is analyzed. The performance of the modified Error Backpropagation Algorithm is shown to be better than that of the standard Error Back Propagation algorithm by various experiments.

키워드