Browse > Article
http://dx.doi.org/10.4218/etrij.11.0110.0114

Structure Learning in Bayesian Networks Using Asexual Reproduction Optimization  

Khanteymoori, Ali Reza (Computer Engineering Department, Amirkabir University of Technology)
Menhaj, Mohammad Bagher (Computer Engineering Department, Amirkabir University of Technology)
Homayounpour, Mohammad Mehdi (Department of Electrical Engineering, Amirkabir University of Technology)
Publication Information
ETRI Journal / v.33, no.1, 2011 , pp. 39-49 More about this Journal
Abstract
A new structure learning approach for Bayesian networks based on asexual reproduction optimization (ARO) is proposed in this paper. ARO can be considered an evolutionary-based algorithm that mathematically models the budding mechanism of asexual reproduction. In ARO, a parent produces a bud through a reproduction operator; thereafter, the parent and its bud compete to survive according to a performance index obtained from the underlying objective function of the optimization problem: This leads to the fitter individual. The convergence measure of ARO is analyzed. The proposed method is applied to real-world and benchmark applications, while its effectiveness is demonstrated through computer simulations. Results of simulations show that ARO outperforms genetic algorithm (GA) because ARO results in a good structure and fast convergence rate in comparison with GA.
Keywords
Bayesian networks; structure learning; evolutionary algorithms; genetic algorithms;
Citations & Related Records

Times Cited By Web Of Science : 0  (Related Records In Web of Science)
Times Cited By SCOPUS : 0
연도 인용수 순위
  • Reference
1 D.M. Chickering, "Optimal Structure Identification with Greedy Search," J. Machine Learning Research, vol. 3, 2002, pp. 507- 554.
2 C. Chow and C. Liu, "Approximating Discrete Probability Distributions with Dependence Trees," IEEE Trans. Inf. Theory, vol. 14, no. 3, 1968, pp. 462-467.   DOI
3 M.A. Faust and R.A. Gulledge, "Identifying Harmful Marine Dinoflagellates," Smithsonian Inst. Contrib. U.S. Natl. Herb., vol. 42, 2002, pp. 1-144.
4 D.M. Chickering, D. Geiger, and D. Heckerman, "Learning Bayesian Networks: Search Methods and Experimental Results," 5th Int. Workshop Artificial Intell. Statistics, 1995, pp. 112-128.
5 H. Wang, D. Dash, and M.J. Druzdzel, "A Method for Evaluating Elicitation Schemes for Probabilistic Models," IEEE Trans. Syst. Man Cybern. B, vol. 32, no. 1, Feb. 2002, pp. 38-43.   DOI   ScienceOn
6 G.M. Provan, "Model Selection for Diagnosis and Treatment Using Temporal Influence Diagrams," Proc. 4th Int. Workshop Artificial Intell. Statistics, 1995, pp. 469-480.
7 P. Larranaga et al., "Structure Learning of Bayesian Network by Genetic Algorithms: A Performance Analysis of Control Parameters," IEEE Trans. Pattern Anal. Machine Intell., vol. 18, no. 9, Sept. 1996, pp. 912-926.   DOI   ScienceOn
8 G.F. Cooper and E.A. Herskovits, "A Bayesian Method for the Induction of Probabilistic Networks from Data," Mach. Learning, vol. 9, no. 4, 1992, pp. 309-347.
9 X. Li, X. He, and S. Yuan, "Learning Bayesian Networks Structures from Incomplete Data Based on Extending Evolutionary Programming," Proc. Int. Conf. Mach. Learning Cybern., vol. 4, Aug. 2005, pp. 2039-2043.
10 M.L. Wong and K.S. Leung, "An Efficient Data Mining Method for Learning Bayesian Networks Using an Evolutionary Algorithm-Based Hybrid Approach," IEEE Trans. Evolutionary Computing, vol. 8, no. 4, Aug. 2004, pp. 378-404.   DOI   ScienceOn
11 D.M. Chickering, "Learning Bayesian Networks is NPComplete," Learning from Data, Artificial Intelligence and Statistics, Springer Verlag, 1996.
12 F.V. Jensen, "Introduction to Bayesian Networks," Dept. of Mathematics and Computer Science, Univ. of Aalborg, Denmark, Technical Report IR 93-2003, 1993.
13 J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, San Mateo, CA: Morgan Kaufmann, 1988.
14 R.E. Neapolitan, Learning Bayesian Networks, Upper Saddle River, NJ: Prentice Hall, 2004.
15 S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, 2nd ed., Upper Saddle River, NJ: Prentice Hall , 2003.
16 R.F. Green and D.L.G. Noakes, "Is a Little Bit of Sex as Good as a Lot?" J. Theoretical Biology, vol. 174, no. 1, 1995, pp. 87-96.   DOI   ScienceOn
17 I.A. Beinlinch et al., "The ALARM Monitoring System: A Case Study with Two Probabilistic Inference Techniques for Belief Networks," Proc. 2nd European Conf. Artificial Intell. Medicine, 1989, pp. 247-256.
18 http://www.norsys.com/networklibrary.html
19 A.V. Ramayya et al., "Binary and Ternary Fission Studies with $^{252}Cf$," Progress Particle Nuclear Physics, vol. 46, no. 1, 2001, pp. 221-229.   DOI   ScienceOn
20 S. Stertz et al., "The Intracellular Sites of Early Replication and Budding of SARS-Coronavirus," Virology, vol. 361, no. 2, 2007, pp. 304-315.   DOI   ScienceOn
21 M.T. Ghiselin, "The Evolution of Sex: A History of Competing Points of View," The Evolution of Sex: An Examination of Current Ideas, R.E. Michod and B.R. Levin, Eds., Sunderland: Sinauer Associates Inc., 1988, pp. 7-23.
22 S. Willcox, N.A. Moltschaniwskyj, and C. Crawford, "Asexual Reproduction in Scyphistomae of Aurelia sp.: Effects of Temperature and Salinity in an Experimental Study," J. Experimental Marine Biology Ecology, vol. 353, no. 1, 2007, pp. 107-114.   DOI   ScienceOn
23 M. Clerc and J. Kennedy, "The Particle Swarm-Explosion, Stability, and Convergence in a Multidimensional Complex Space," IEEE Trans. Evolutionary Computation, vol. 6, 2002, pp. 58-73.   DOI   ScienceOn
24 M. Mitchel, An Introduction to Genetic Algorithms, MIT Press, 1999.
25 M. Dorigo and T. Stützle, Ant Colony Optimization, India, New Delhi: Prentice-Hall, 2005.
26 C. Zilberberg, A.M. Solé-Cava, and M. Klautau, "The Extent of Asexual Reproduction in Sponges of the Genus Chondrilla (Demospongiae: Chondrosida) from the Caribbean and the Brazilian Coasts," J. Experimental Marine Biology Ecology, vol. 336, no. 2, 2006, pp. 211-220.   DOI   ScienceOn
27 K. Holmstrom and H.J. Jensen, "Who Runs Fastest in an Adaptive Landscape: Sexual Versus Asexual Reproduction," Physica A: Statistical Theoretical Physics, vol. 337, no. 1-2, 2004, pp. 185-195.   DOI
28 T. Yanagi, T. Yachi and N. Okuda, "Photoperiodic Reaction of Sexual and Asexual Reproduction in Fragaria Chiloensis L. CHI-24-1 Plants Grown at Various Temperatures," Scientia Horticulturae, vol. 110, no. 2, 2006, pp. 187-191.   DOI   ScienceOn
29 W. Song, "Morphogenesis of Cyrtohymena tetracirrata (Ciliophora, Hypotrichia, Oxytrichidae) during Binary Fission," European J. Protistology, vol. 40, no. 3, 2004, pp. 245-254.   DOI   ScienceOn
30 K. Lee et al., "Light Regulation of Asexual Development in the Rice Blast Fungus, Magnaporthe Oryzae," Fungal Genetics Biology, vol. 43, no. 10, 2006, pp. 694-706.   DOI   ScienceOn
31 F. Prall and C. Ostwald, "High-Degree Tumor Budding and Podia-Formation in Sporadic Colorectal Carcinomas with K-Ras Gene Mutations," Hum. Pathol., vol. 38, 2007, pp. 1696-702.   DOI   ScienceOn
32 http://en.wikipedia.org/wiki/Bayesian_network
33 D. Heckerman, D. Geiger, and D.M. Chickering, "Learning Bayesian Networks: The Combination of Knowledge and Statistical Data," Mach. Learning, vol. 20, 1995, pp. 197-243.
34 R.W. Robinson, "Counting Unlabeled Acyclic Digraphs," Combinatorial Mathematics V: Proc. 5th Australian Conf., Aug. 24-26, 1976.