Browse > Article
http://dx.doi.org/10.3745/KIPSTB.2007.14-B.7.541

Fast Simulated Annealing with Greedy Selection  

Lee, Chung-Yeol (한국과학기술원 전자전산학과)
Lee, Sun-Young (한국과학기술원 전자전산학과)
Lee, Soo-Min (University of Illinois, 전자전산학과)
Lee, Jong-Seok (한국과학기술원 전자전산학부)
Park, Cheol-Hoon (한국과학기술원 전자전산학부)
Abstract
Due to the mathematical convergence property, Simulated Annealing (SA) has been one of the most popular optimization algorithms. However, because of its problem of slow convergence in the practical use, many variations of SA like Fast SA (FSA) have been developed for faster convergence. In this paper, we propose and prove that Greedy SA (GSA) also finds the global optimum in probability in the continuous space optimization problems. Because the greedy selection does not allow the cost to become worse, GSA is expected to have faster convergence than the conventional FSA that uses Metropolis selection. In the computer simulation, the proposed method is shown to have as good performance as FSA with Metropolis selection in the viewpoints of the convergence speed and the quality of the found solution. Furthermore, the greedy selection does not concern the cost value itself but uses only dominance of the costs of solutions, which makes GSA invariant to the problem scaling.
Keywords
Simulated Annealing; Greedy Selection; Convergence Proof;
Citations & Related Records
연도 인용수 순위
  • Reference
1 W. Ben-Ameur, 'Computing the Initial Temperature of Simulated Annealing,' Computational Optimization and Applications, Vol.29, No.3, pp.369-385, 2004   DOI
2 D. Mitra, F. Romeo and A. L. Sangiovanni-Vincentelli, 'Convergence and finite-time behavior of simulated annealing,' Advances in Applied Probability, Vol.18, No.3, pp.747-771, 1986   DOI   ScienceOn
3 P. J. M. Laarhoven and E. H. L. Aarts, 'Simulated Annealing: Theory and Applications', Kluwer Academic Publishers, 1987
4 S. Kirkpatrick, C. D. Gelatt, and M. P. Vecchi, 'Optimization by Simulated Annealing,' Science, Vol.220, pp.671-680, 1983   DOI   ScienceOn
5 H. H. Szu and R. L. Hartley, 'Fast Simulated Annealing,' Physics Letters A, Vol.122, pp.157-162, 1987   DOI   ScienceOn
6 D. Nam, J.-S. Lee and C. H. Park, 'N-dimensional Cauchy neighbor generation for the fast simulated annealing,' IEICE Trans. on Information and Systems, Vol.E87-D, No.11, pp.2499-2502, Nov. 2004
7 R. L. Yang, 'Convergence of the simulated annealing algorithm for continuous global optimization,' Journal of Optimization Theory and Applications, Vol.104, pp.691-716, 2000   DOI   ScienceOn
8 K. D. Jong, 'An analysis of the behaviour of a class of genetic adaptive systems', Ph.D. Dissertation, University of Michigan, 1975
9 http://www.cs.cmu.edu/afs/cs/project/ai-repository/ai/area s/genetic/ga/systems/genesys/0.html
10 H. H. Szu and R. L. Hartley, 'Nonconvex optimization by fast simulated annealing,' Proceedings of the IEEE, Vol 75, No.11, Nov. 1987
11 T.-C. Chen and Y.-W. Chang, 'Modern floorplanning based on fast simulated annealing,' Proceedings of the ACM International Symposium on Physical Design, pp.104-112, San Francisco, California, Apr. 2005   DOI
12 S. A. Kravitz and R. A. Rutenbar, 'Placement by Simulated Annealing on a Multiprocessor,' IEEE trans. on computer-aided design of Integrated Circuits and Systems, Vol.6, No.4, pp.534-549, 1987   DOI   ScienceOn
13 P. Moscato and J.F. Fontanari, 'Stochastic versus Deterministic Update in Simulated Annealing,' Physics Letters A, Vol.146, No.4, pp.204-208, 1990   DOI   ScienceOn
14 http://en.wikipedia.org/wiki/Greedy_algorithm