Performance Improvement of Backpropagation Algorithm by Automatic Tuning of Learning Rate using Fuzzy Logic System |
Jung, Kyung-Kwon
(Department of Electronic Engineering, Dongguk University)
Lim, Joong-Kyu (Department of Electronic Engineering, Dongguk University) Chung, Sung-Boo (Department of Electronic Engineering, Seoil Colleg) Eom, Ki-Hwan (Department of Electronic Engineering, Dongguk University) |
1 | Martin T. Hagan, Howard B. Demuth, Mark Beale, Neural Network Design, PWS Publishing, Boston, 1995 |
2 | Peiman G. Maghami and Dean W. Sparks, 'Design of Neural Networks for Fast Convergence and Accuracy: Dynamics and Control', IEEE Transactions on Neural Networks, vol. 11, no. 11, pp. 113-123, 2000 DOI ScienceOn |
3 | C. Charalambous, 'Conjugate gradient algorithm for efficient training of artificial neural networks,' lEE Proceedings, vol. 139, no. 3, pp. 301-310, 1992 |
4 | M. T. Hagan and M. Menhaj, 'Training feedforward networks with the Marquardt algorithm,' IEEE Transactions on Neural Networks, vol. 5, no. 6, pp. 187-199, 1994 DOI PUBMED ScienceOn |
5 | T.P. Vogl, J.K. Mangis, A.K. Zigler, W.T.zink and D.L.Alkon, 'Accelerating the convergence of the backpropagation method', Biological Cybernetics., vol. 59, pp. 256-264, 1988 |
6 | Laurene Fausett, Fundamentals of Neural Networks, Prentice Hall, 1994 |
7 | Tokumitsu Fujita, Takao Watanebe and Keiichiro Yasuda, 'A Study on Improvement in Learning Efficiency of Multilayered Neural Networks based on Dynamical System,' T.IEE Japan, vol. 117-C, no. 12, pp. 1848-1855, 1997 |
8 | W. Pedrycz, Fuzzy Control and Fuzzy Systems, John Wiley & Sons, Inc., 1992 |
9 | H. Y. Y. Sanossian and D. J. Evans, 'Gradient Range-Based Heuristic Method for Accelerating Neural Network Convergence,' Integrated ComputerAided Engineering, vol. 2, pp. 147-152, 1995 |
10 | Howard Hemuth, Mark Beale, Neural Network Toolbox User's Guide, The Math Works, 1994 |
11 | R. A. Jacobs, 'Increased rates of convergence through learning rate adaptation,' Neural Networks, vol. 1, no. 4, pp. 295-308, 1988 DOI ScienceOn |