Browse > Article

A Bayesian Sampling Algorithm for Evolving Random Hypergraph Models Representing Higher-Order Correlations  

Lee, Si-Eun (백석대학교 정보통신학부)
Lee, In-Hee (서울대학교 컴퓨터공학부)
Zhang, Byoung-Tak (서울대학교 컴퓨터공학부)
Abstract
A number of estimation of distribution algorithms have been proposed that do not use explicitly crossover and mutation of traditional genetic algorithms, but estimate the distribution of population for more efficient search. But because it is not easy to discover higher-order correlations of variables, lower-order correlations are estimated most cases under various constraints. In this paper, we propose a new estimation of distribution algorithm that represents higher-order correlations of the data and finds global optimum more efficiently. The proposed algorithm represents the higher-order correlations among variables by building random hypergraph model composed of hyperedges consisting of variables which are expected to be correlated, and generates the next population by Bayesian sampling algorithm Experimental results show that the proposed algorithm can find global optimum and outperforms the simple genetic algorithm and BOA(Bayesian Optimization Algorithm) on decomposable functions with deceptive building blocks.
Keywords
Bayesian Sampling Algorithm; Bayesian evolutionary computation; EDA; random hypergraph;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Baluja, S., 'Population-based incremental learning: A method for integrating genetic search based function optimization and competitive learning,' Tech. Rep. No.CMU_CS_94_163, Pittsburgh, PA: Carnegie Mellon University, 1994
2 Harik, G. R., Lobo, F. G., & Goldberg, D. E., 'The compact genetic algorithm,' IlliGAL Report No.97006, Urbana, IL: University Of Illinois at Urbana Champaign, 1997
3 Berge, C., Hypergraphs, North-Holland. 1989
4 Goldberg, D. E., 'Simple genetic algorithms and the minimal deceptive problem,' Genetic Algorithms and Simulated Annealing, Pitman, pp. 74-88, 1987
5 B.-T. Zhang, 'A unified Bayesian framework for evolutionary learning and optimization,' Advances in Evolutionary Computing, Springer-Verlag, Chap15, pp. 393-412, 2003
6 Muhlenbein, H. & Paass, G., 'From recombination of genes to the estimation of distributions I. Binary parameters,' Parallel Problem Solving from Nature, pp. 178-187, 1996
7 Claudio F. Lima, Pelikan, M., Goldberg, D. E., & Fernando G. Lobo, Kumara Sastry, and Mark Hauschild, 'Influence of selection and replacement strategies on linkage learning in BOA.,' IEEE International Conference on Evolutionary Computation (CEC2007), pp. 1083-1090, 2007
8 B.-T. Zhang, 'Random hypergraph models of learning and memory in biomolecular networks: shorter–term adaptability vs longer-term persistency,' IEEE Symposium on Foundations of Computational Intelligence, pp. 344-349, 2007
9 B.-T. Zhang & J.-K. Kim, 'DNA hypernetworks for information storage and retrieval,' Lecture Notes in Computer Science, DNA12, 4287:298-307, 2006   과학기술학회마을
10 B.-T. Zhang, 'Hypernetworks: A molecular evolutionary architecture for cognitive learning and memory,' IEEE Computational Intelligence Magazine, 3(3):49-63, 2008   DOI   ScienceOn
11 Pelikan, M., & Muhlenbein, H., 'The bivariate marginal distribution algorithm,' Advances in Soft Computing-Engineering Design and Manufacturing, pp. 521-535, 1999
12 Deb, K. & Goldberg, D. E. 'Analyzing deception in trap functions,' Proceedings of Foundations of Genetic Algorithms FOGA-II, pp. 93-108, 1993
13 Larranaga, P., 'A review on estimation of distribution algorithms,' Estimation of Distribution Algoruthms: A New Tools for Evolutionary Computation, Kluwer Academic Publisher, pp. 57-100, 2001
14 C.-H. Park, S.-J. Kim, S. Kim, D.-Y. Cho & B.-T. Zhang, 'Finding cancer related gene combinations using a molecular evolutionary algorithm,' IEEE 7th international conference on Bioinformations & Bioengineering (BIBE2007), pp. 158-163, 2007
15 Pelikan, M., Goldberg, D. E., & Cantu-Paz, E., 'BOA: The Bayesian optimization algorithm,' Genetic and Evolutionary Computation Conference GECCO-99, Vol.1, pp. 525-532, 1999
16 S. Kim, M.-O. Heo & B.-T. Zhang, 'Text classifier evolved on a simulated DNA computer,' IEEE Congress on Evolutionary Computation(CEC2006), pp. 9196-9202, 2006
17 B.-T. Zhang, 'A Bayesian framework for evolutionary computation,' IEEE Congress on Evolutionary Computation(CEC1999), pp. 722-728, 1999