DOI QR코드

DOI QR Code

Development of a Modified Random Signal-based Learning using Simulated Annealing

  • Han, Chang-Wook (Department of Electrical Engineering, Dong-Eui University) ;
  • Lee, Yeunghak (Avionics Electronic Engineering, Kyungwoon University)
  • Received : 2015.02.03
  • Accepted : 2015.04.04
  • Published : 2015.03.31

Abstract

This paper describes the application of a simulated annealing to a random signal-based learning. The simulated annealing is used to generate the reinforcement signal which is used in the random signal-based learning. Random signal-based learning is similar to the reinforcement learning of neural network. It is poor at hill-climbing, whereas simulated annealing has an ability of probabilistic hill-climbing. Therefore, hybridizing a random signal-based learning with the simulated annealing can produce better performance than before. The validity of the proposed algorithm is confirmed by applying it to two different examples. One is finding the minimum of the nonlinear function. And the other is the optimization of fuzzy control rules using inverted pendulum.

Keywords

References

  1. T. J. Procyk and E. H. Mamdani, "A Linguistic Self-Organizing Process Controller," Automatica, vol. 15, no. 1, pp. 15-30, January 1979. https://doi.org/10.1016/0005-1098(79)90084-0
  2. S. Kirkpatrick, C. D. Gelatt Jr., and M. P. Vecchi, "Optimization by simulated annealing," Science, vol. 220, pp. 671-680, 1983. https://doi.org/10.1126/science.220.4598.671
  3. N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller, and E. Teller, "Equation of state calculations by fast computing machines," J. Chem. Phys. 21, pp. 1087-1092, 1953. https://doi.org/10.1063/1.1699114
  4. S. H. Jeong, C. W. Han, J. I. Park and S. H. Kwon, "A Study on Learning Scheme of Self-Learning Rule-Based Fuzzy Controller using Random Variable Sequence," Proc. of the American Control Conference, vol. 3, pp. 1862-1863, 1998.
  5. D. O. Hebb, "The Organization of Behavior," John Wiley, New York, NY, 1949.
  6. Il-kwon Jeong and Ju-jang Lee, "Adaptive simulated annealing genetic algorithm for control applications," International Journal of Systems Science, vol. 27, no. 2, pp. 241-253, February 1996. https://doi.org/10.1080/00207729608929210
  7. A. Homaifar and E. McCormick, "Simultaneous design of membership functions and rule sets for fuzzy controllers using genetic algorithms," IEEE Trans. Fuzzy Syst., vol. 3, no. 2, pp. 129-139, May 1995. https://doi.org/10.1109/91.388168
  8. Chin-Teng Lin and C. S. George Lee, "Neural fuzzy systems," Prentice-Hall, 1996.
  9. D. E. Goldberg, "Genetic Algorithms in Search, Optimization and Machine Learning," Addison-Wesley, 1989.