Browse > Article

On the enhancement of the learning efficiency of the adaptive back propagation neural network using the generating and adding the hidden layer node  

Kim, Eun-Won (Dept. of Electronic, Information & Communication)
Hong, Bong-Wha (Dept. of Computer aided mathematical information Science Semyung Univ.)
Publication Information
Journal of the Institute of Electronics Engineers of Korea TE / v.39, no.2, 2002 , pp. 66-75 More about this Journal
Abstract
This paper presents an adaptive back propagation algorithm that its able to enhancement for the learning efficiency with updating the learning parameter and varies the number of hidden layer node by the generated error, adaptively. This algorithm is expected to escaping from the local minimum and make the best environment for the convergence of the back propagation neural network. On the simulation tested this algorithm on three learning pattern. One was exclusive-OR learning and the another was 3-parity problem and 7${\times}$5 dot alphabetic font learning. In result that the probability of becoming trapped in local minimum was reduce. Furthermore, the neural network enhanced to learning efficient about 17.6%~64.7% for the existed back propagation. 
Keywords
Citations & Related Records
연도 인용수 순위
  • Reference
1 James A. Freeman, David M. Skapura, Neural Networks Algorithms, Applications, and Programming Techniques, Addison Wesley pp. 89-125, 1991
2 R,A Jacobs, 'Increased Rates of Convergence through Learning Rate Adaptation', Neural Networks, vol. 1, pp. 295-307, 1988
3 D. E. Rumelhart, G. E. Hinton, & R. J. Williams, 'Learning representation by back propagation errors', Nature, vol. 323, pp. 533-536, 1986
4 DARPA Neural Network study, AFCEA international press, 1988
5 Yoshio Hirose, Koichi Yamashita and Shimpei Hjjiya, 'Back-Propagation algorithm which varies the number of hidden units', IEEE Transaction on Neural Networks, vol. 4, pp 61-66. 1991
6 T. J. Sejnowski, & C. R. Rosenberg, 'Parallel networks that learn to pronounce English text', Complex Systems, vol. 1, pp. 145-168, 1987
7 홍봉화, '적응 역전파 신경회로망의 초기연결강도 설정에 관한 연구', 한국정보기술전략혁신학회 논문지, 제4권 제1호, 71-79쪽, 2001년 3월
8 D. E. Rumelhart, J. L. McClelland and the PDP Reserch Group(Eds.), Parallel Distributed Processing : Explorations in the Microstructure of Cognition, vol. 1 and 2, MIT Press, 1986
9 Yao Zhang, 'Updating learning rates for back propagation network', International Joint Conference on Neural Networks, vol. 1 Nagoya Japan, pp. 569-572, Oct. 1993
10 홍봉화, 김은원, 조원경, '역전파 신경회로망에서 은닉층 노드수에 따른 오차 및 적응학습파라미터 의 변화에 관한 연구', 전자공학회논문지, 제38권 TE편, 제1호, 1-10쪽, 2001년 3월
11 Jacek M. Zurada, Introduction to Artificial Neural System, West, pp. 163-248, 1992
12 D .E. Rumelhart, G. E. Hinton & R. J. Williams, Learning internal representations by error propagation, parallel distributed processing, vol. 1, pp. 318-362. MIT Press, 1986
13 Yoh-Han Pao, Adative Pattern Recognition and Neural Networks. Addison Wesley pp. 113-139, 1989
14 Ali A. Minai and Ronald D. Williams, 'Acceleration of back propagation through learning rate momentum adaptation', International Joint Conference on Neural Network, vol. 1, Nagoya Japan, pp. 676-679, Oct ., 1993