International Journal of Control, Automation, and Systems

Institute of Control, Robotics and Systems (제어로봇시스템학회)
권호 표지

Game Theory Based Coevolutionary Algorithm: A New Computational Coevolutionary Approach

  • Sim, Kwee-Bo (School of Electrical and Electronic Engineering, Chung-Ang University) ;
  • Lee, Dong-Wook (Department of Electrical and Computer Engineering, The University of Tennessee) ;
  • Kim, Ji-Yoon (School of Electrical and Electronic Engineering, Chung-Ang University)
  • Published : 2004.12.01
Download PDF
⟨ Previous Next ⟩

Abstract

Game theory is a method of mathematical analysis developed to study the decision making process. In 1928, Von Neumann mathematically proved that every two-person, zero-sum game with many pure finite strategies for each player is deterministic. In the early 50's, Nash presented another concept as the basis for a generalization of Von Neumann's theorem. Another central achievement of game theory is the introduction of evolutionary game theory, by which agents can play optimal strategies in the absence of rationality. Through the process of Darwinian selection, a population of agents can evolve to an Evolutionary Stable Strategy (ESS) as introduced by Maynard Smith in 1982. Keeping pace with these game theoretical studies, the first computer simulation of coevolution was tried out by Hillis. Moreover, Kauffman proposed the NK model to analyze coevolutionary dynamics between different species. He showed how coevolutionary phenomenon reaches static states and that these states are either Nash equilibrium or ESS in game theory. Since studies concerning coevolutionary phenomenon were initiated, there have been numerous other researchers who have developed coevolutionary algorithms. In this paper we propose a new coevolutionary algorithm named Game theory based Coevolutionary Algorithm (GCEA) and we confirm that this algorithm can be a solution of evolutionary problems by searching the ESS. To evaluate this newly designed approach, we solve several test Multiobjective Optimization Problems (MOPs). From the results of these evaluations, we confirm that evolutionary game can be embodied by the coevolutionary algorithm and analyze the optimization performance of our algorithm by comparing the performance of our algorithm with that of other evolutionary optimization algorithms.

Keywords

References

  1. Game Theory and Animal Behavior L. A. Dugatkin;H. K. Reeve(Eds.)
  2. The Theory of Games and Economic Behavior J. Von Neumann;O. Morgenstern
  3. Annals of Mathematics v.54 Noncooperative games J. F. Nash
  4. Essays on Game Theory J. F. Nash
  5. Journal of Theoretical Biology v.1 Evolution and the theory of games R. C. Lewontin https://doi.org/10.1016/0022-5193(61)90038-8
  6. Quarterly Review of Biology v.49 An optimal strategy of evolution L. B. Slobodkin;A. Rapoport https://doi.org/10.1086/408082
  7. Nature v.246 The logic of animal conflict J. Maynard Smith;G. R. Price https://doi.org/10.1038/246015a0
  8. Artificial Life Ⅱ Co-evolving parasites improve simulated evolution as an optimization procedure W. D. Hillis
  9. Artificial Life Ⅱ Co-evolution to the edge of chaos: Coupled fitness landscapes, poised states, and co-evolutionary avalanches S. A. Kauffman;S. Johnsen
  10. Evolutionary Computation v.5 no.1 New methods for competitive coevolution C. D. Rosin;R. K. Belew https://doi.org/10.1162/evco.1997.5.1.1
  11. Evolution and the Theory of Games J. Maynard Smith
  12. Genetic Algorithms and Simulated Annealing The evolution of strategies in the iterated prisoner’s dilemma R. Axelrod;L. Davis(Ed.)
  13. Proc. of the 5th Int. Conf. on Genetic Algorithms Competitive environments evolve better solutions for complex tasks P. J. Angeline;J. B. Pollack
  14. Mathematics for operational research R. Weber
  15. Proc. of GECCO 2001 Workshop on Coevolution Game theory and the simple coevolutionary algorithm: Some preliminary results on fitness sharing S. G. Ficici;J. B. Pollack
  16. Theoretical Population Biology v.37 Evolutionary stability: One concept, several meanings S. Lessard https://doi.org/10.1016/0040-5809(90)90033-R
  17. Journal of Theoretical Biology v.115 The essential properties of evolutionary stability G. W. Rowe;I. F. Harvey;S. F. Hubbard https://doi.org/10.1016/S0022-5193(85)80100-4
  18. Nonlinear Dynamics and Chaos S. H. Strogatz
  19. Artificial Life v.2 no.4 “Coevolutionary computation J. Paredis https://doi.org/10.1162/artl.1995.2.4.355
  20. Artificial Life Ⅳ Steps towards coevolutionary classification neural networks J. Paredis
  21. Proc. of Int. Conf. on Artificial Neural Networks and Genetic Algorithms Coevolutionary process control J. Paredis
  22. Proc. of PPSN-Ⅲ, Lecture Notes in Computer Science 866 Coevolutionary constraint satisfaction J. Paredis
  23. Proc. of the 6th Int. Conf. on Genetic Algorithms The symbiotic evolution of solutions and their representations J. Paredis
  24. Proc. of European Conf. on Artificial Intelligence Symbiotic coevolution for epistatic problems J. Paredis;W. Wahlser(Ed.)
  25. Proc. of the 7th Int. Conf. on Genetic Algorithms Coevolving cellular automata: Be aware of the red queen! J. Paredis
  26. Ph. D. dissertation, University of Michigan Computer Simulations of Genetic Adaptation: Parallel Subcomponent Interaction in a Multilocus Model P. Grosso
  27. Proc. of the 2nd Int. Conf. on Genetic Algorithms Punctuated equilibria: A parallel genetic algorithm J. Cohoon;S. Hegde;W. Martin;D. Richards
  28. Proc. of the 2nd Int. Conf. on Genetic Algorithms A parallel genetic algorithm C. Petty;M. Leuze;J. Grenfenstette
  29. Proc. of the 3rd Int. Conf. on Genetic Algorithms Distributed genetic algorithms R. Tanese
  30. Journal of Experimental and Theoretical Artificial Intelligence v.2 Genitor Ⅱ: A distributed genetic algorithm D. Whitley;T. Starkweather https://doi.org/10.1080/09528139008953723
  31. Proc. of the 6th Int. Conf. on Genetic Algorithms A coevolutionary approach to learning sequential decision rules M. A. Potter;K. A. De Jong;J. J. Grefenstette
  32. Proc. of Parallel Problem Solving from Nature A cooperative coevolutionary approach to function optimization M. A. Potter;K. A. De Jong
  33. Proc. of the 6th Int. Conf. on Genetic Algorithms A coevolutionary approach to learning sequential decision rules M. A. Potter;K. A. De Jong;J. J. Grefenstette
  34. Proc. of Genetic and Evolutionary Computation Conf. Workshop Program Comparison of multiobjective evolutionary algorithms: Empirical results E. Zitzler;K. Deb;L. Thiele
  35. Proc. of 5th Int. Conf. on Parallel Problem Solving from Nature Multiobjective optimization using evolutionary algorithms - A comparative case study E. Zitzler;L. Thiele;A. E. Eiben(ed.);T. Beack(ed.);M. Schoenauer(ed.);H. -P. Schwefel(ed.)
  36. Ph. D. dissertation, The Swiss Federal Institute of Technology Evolutionary Algorithms for Multiobjective Optimization: Methods and Applications E. Zitzler
  37. IEEE Trans. on Evolutionary Computation v.3 no.4 Multiobjective evolutionary algorithms: A comparative case study and the strength pareto approach E. Zitzler https://doi.org/10.1109/4235.797969
  38. Technical Report No. CI-49/98 Multi-objective genetic algorithms: Problem difficulties and construction of test functions K. Deb
  39. Multiobjective Programming and Planning J. L. Cohon
  40. Multiple Criteria Optimization: Theory, Computation, and Application R. E. Steuer
  41. IEEE Trans. on Evolutionary Computation v.3 no.4 Multiobjective evolutionary algorithms: A comparative case study and the strength Pareto approach E. Zitzler;L. Thiele https://doi.org/10.1109/4235.797969
  42. New Directions in Optimum Structural Design Multicriterion optimization in structural design J. Koski;E. Atrek(ed.);R. H. Gallagher(ed.);K. M. Ragsdell(ed.);O. C. Zienkiewicz(ed.)
  43. Ph. D. dissertation, Vanderbilt University Some Experiments in Machine Learning Using Vector Evaluated Genetic Algorithms J. D. Schaffer
  44. Proc. of Int. Conf. on Genetic Algorithms and Their Applications Multiple objective optimization with vector evaluated genetic algorithms J. D. Schaffer
  45. IlliCAL Report 93005 Multiobjective optimization using the niched Pareto genetic algorithm J. Horn;N. Nafpliotis
  46. Proc. of the 1st Int. Conf. on Genetic Algorithms Compaction of symbolic layout using genetic algorithms M. P. Fourman
  47. Proc. of Parallel Problem Solving from Nature, Lecture Notes in Computer Science 496 A variant of evolution strategies for vector optimization F. Kursawe;H.-P. Schwefel(ed.);R. Maenner(ed.)
  48. Struct. Optim. v.4 Genetic search strategies in multicriterion optimal design P. Hajela;C.-Y. Lin https://doi.org/10.1007/BF01759923
  49. IEEE Trans. on Systems, Man, and Cybernetics Part A: Systems and Humans v.28 no.1 Multiobjective optimization and multiple constraint handling with evolutionary algorithms - Part I: A unified formulation C. M. Fonseca;P. J. Fleming https://doi.org/10.1109/3468.650319
  50. Genetic Algorithms in Search, Optimization and Machine Learning D. E. Goldberg
  51. Proc. of the 5th Int. Conf. on Genetic Algorithms Genetic algorithms for multiobjective optimization: Formulation, discussion and generalization C. M. Fonseca;P. J. Fleming
  52. Evolutionary Computation v.3 no.1 An overview of evolutionary algorithms in multiobjective optimization C. M. Fonseca;P. J. Fleming https://doi.org/10.1162/evco.1995.3.1.1
  53. Proc. of the 2nd Int. Conf. on Genetic Algorithms Genetic algorithms with sharing for multi-modal function optimization D. E. Goldberg;J. J. Richardson
  54. Proc. of IEEE World Congr. on Computational Intelligence v.1 A niched Pareto genetic algorithm for multiobjective optimization J. Horn;N. Nafpliotis;D. E. Goldberg
  55. Evolutionary Computation v.2 no.3 Multiobjective optimization using non-dominated sorting in genetic algorithms N. Srinivas;K. Deb https://doi.org/10.1162/evco.1994.2.3.221
  56. Genetic Algorithms in Engineering and Computer Science Hybrid GA for multiobjective aerodynamic shape optimization C. Poloni;M. Galan(ed.);G. Winter(ed.);J. Periaux(ed.);P. Cuesta(ed.)
  57. Parallel CFD 96 Parallel geneticsolution for multiobjective MDO R. Makinen;P. Neittaanmaki;J. Periaux;M. Sefrioui;J. Toivonen
  58. System Design Using Evolutionary Optimization: Genetic Algorithms Genetic algorithms for electromagnetic backscattering: Multiobjective optimization M.-O. Bristeau;R. Glowinski;B. Mantel;J. Periaux;M. Sefrioui
  59. Proc. of Genetic and Evolutionary Computation Conf. Workshop Program Comparison of multiobjective evolutionary algorithms: Empirical results E. Zitzler;K. Deb;L. Thiele
  60. Evolutionary Computation v.7 no.3 Multi-objective genetic algorithms: Problem difficulties and construction of test problems K. Deb https://doi.org/10.1162/evco.1999.7.3.205