ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Structure Learning in Bayesian Networks Using Asexual Reproduction Optimization

  • Received : 2010.02.28
  • Accepted : 2010.08.23
  • Published : 2011.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

A new structure learning approach for Bayesian networks based on asexual reproduction optimization (ARO) is proposed in this paper. ARO can be considered an evolutionary-based algorithm that mathematically models the budding mechanism of asexual reproduction. In ARO, a parent produces a bud through a reproduction operator; thereafter, the parent and its bud compete to survive according to a performance index obtained from the underlying objective function of the optimization problem: This leads to the fitter individual. The convergence measure of ARO is analyzed. The proposed method is applied to real-world and benchmark applications, while its effectiveness is demonstrated through computer simulations. Results of simulations show that ARO outperforms genetic algorithm (GA) because ARO results in a good structure and fast convergence rate in comparison with GA.

Keywords

References

  1. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, San Mateo, CA: Morgan Kaufmann, 1988.
  2. R.E. Neapolitan, Learning Bayesian Networks, Upper Saddle River, NJ: Prentice Hall, 2004.
  3. S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, 2nd ed., Upper Saddle River, NJ: Prentice Hall , 2003.
  4. F.V. Jensen, "Introduction to Bayesian Networks," Dept. of Mathematics and Computer Science, Univ. of Aalborg, Denmark, Technical Report IR 93-2003, 1993.
  5. M.L. Wong and K.S. Leung, "An Efficient Data Mining Method for Learning Bayesian Networks Using an Evolutionary Algorithm-Based Hybrid Approach," IEEE Trans. Evolutionary Computing, vol. 8, no. 4, Aug. 2004, pp. 378-404. https://doi.org/10.1109/TEVC.2004.830334
  6. D.M. Chickering, D. Geiger, and D. Heckerman, "Learning Bayesian Networks: Search Methods and Experimental Results," 5th Int. Workshop Artificial Intell. Statistics, 1995, pp. 112-128.
  7. H. Wang, D. Dash, and M.J. Druzdzel, "A Method for Evaluating Elicitation Schemes for Probabilistic Models," IEEE Trans. Syst. Man Cybern. B, vol. 32, no. 1, Feb. 2002, pp. 38-43. https://doi.org/10.1109/3477.979958
  8. G.M. Provan, "Model Selection for Diagnosis and Treatment Using Temporal Influence Diagrams," Proc. 4th Int. Workshop Artificial Intell. Statistics, 1995, pp. 469-480.
  9. P. Larranaga et al., "Structure Learning of Bayesian Network by Genetic Algorithms: A Performance Analysis of Control Parameters," IEEE Trans. Pattern Anal. Machine Intell., vol. 18, no. 9, Sept. 1996, pp. 912-926. https://doi.org/10.1109/34.537345
  10. G.F. Cooper and E.A. Herskovits, "A Bayesian Method for the Induction of Probabilistic Networks from Data," Mach. Learning, vol. 9, no. 4, 1992, pp. 309-347.
  11. X. Li, X. He, and S. Yuan, "Learning Bayesian Networks Structures from Incomplete Data Based on Extending Evolutionary Programming," Proc. Int. Conf. Mach. Learning Cybern., vol. 4, Aug. 2005, pp. 2039-2043.
  12. D.M. Chickering, "Learning Bayesian Networks is NPComplete," Learning from Data, Artificial Intelligence and Statistics, Springer Verlag, 1996.
  13. http://en.wikipedia.org/wiki/Bayesian_network
  14. D. Heckerman, D. Geiger, and D.M. Chickering, "Learning Bayesian Networks: The Combination of Knowledge and Statistical Data," Mach. Learning, vol. 20, 1995, pp. 197-243.
  15. R.W. Robinson, "Counting Unlabeled Acyclic Digraphs," Combinatorial Mathematics V: Proc. 5th Australian Conf., Aug. 24-26, 1976.
  16. D.M. Chickering, "Optimal Structure Identification with Greedy Search," J. Machine Learning Research, vol. 3, 2002, pp. 507- 554.
  17. C. Chow and C. Liu, "Approximating Discrete Probability Distributions with Dependence Trees," IEEE Trans. Inf. Theory, vol. 14, no. 3, 1968, pp. 462-467. https://doi.org/10.1109/TIT.1968.1054142
  18. M.A. Faust and R.A. Gulledge, "Identifying Harmful Marine Dinoflagellates," Smithsonian Inst. Contrib. U.S. Natl. Herb., vol. 42, 2002, pp. 1-144.
  19. S. Willcox, N.A. Moltschaniwskyj, and C. Crawford, "Asexual Reproduction in Scyphistomae of Aurelia sp.: Effects of Temperature and Salinity in an Experimental Study," J. Experimental Marine Biology Ecology, vol. 353, no. 1, 2007, pp. 107-114. https://doi.org/10.1016/j.jembe.2007.09.006
  20. C. Zilberberg, A.M. Solé-Cava, and M. Klautau, "The Extent of Asexual Reproduction in Sponges of the Genus Chondrilla (Demospongiae: Chondrosida) from the Caribbean and the Brazilian Coasts," J. Experimental Marine Biology Ecology, vol. 336, no. 2, 2006, pp. 211-220. https://doi.org/10.1016/j.jembe.2006.05.010
  21. K. Holmstrom and H.J. Jensen, "Who Runs Fastest in an Adaptive Landscape: Sexual Versus Asexual Reproduction," Physica A: Statistical Theoretical Physics, vol. 337, no. 1-2, 2004, pp. 185-195. https://doi.org/10.1016/j.physa.2004.01.045
  22. W. Song, "Morphogenesis of Cyrtohymena tetracirrata (Ciliophora, Hypotrichia, Oxytrichidae) during Binary Fission," European J. Protistology, vol. 40, no. 3, 2004, pp. 245-254. https://doi.org/10.1016/j.ejop.2004.03.003
  23. K. Lee et al., "Light Regulation of Asexual Development in the Rice Blast Fungus, Magnaporthe Oryzae," Fungal Genetics Biology, vol. 43, no. 10, 2006, pp. 694-706. https://doi.org/10.1016/j.fgb.2006.04.005
  24. T. Yanagi, T. Yachi and N. Okuda, "Photoperiodic Reaction of Sexual and Asexual Reproduction in Fragaria Chiloensis L. CHI-24-1 Plants Grown at Various Temperatures," Scientia Horticulturae, vol. 110, no. 2, 2006, pp. 187-191. https://doi.org/10.1016/j.scienta.2006.07.004
  25. F. Prall and C. Ostwald, "High-Degree Tumor Budding and Podia-Formation in Sporadic Colorectal Carcinomas with K-Ras Gene Mutations," Hum. Pathol., vol. 38, 2007, pp. 1696-702. https://doi.org/10.1016/j.humpath.2007.04.002
  26. A.V. Ramayya et al., "Binary and Ternary Fission Studies with $^{252}Cf$," Progress Particle Nuclear Physics, vol. 46, no. 1, 2001, pp. 221-229. https://doi.org/10.1016/S0146-6410(01)00127-2
  27. S. Stertz et al., "The Intracellular Sites of Early Replication and Budding of SARS-Coronavirus," Virology, vol. 361, no. 2, 2007, pp. 304-315. https://doi.org/10.1016/j.virol.2006.11.027
  28. R.F. Green and D.L.G. Noakes, "Is a Little Bit of Sex as Good as a Lot?" J. Theoretical Biology, vol. 174, no. 1, 1995, pp. 87-96. https://doi.org/10.1006/jtbi.1995.0081
  29. M.T. Ghiselin, "The Evolution of Sex: A History of Competing Points of View," The Evolution of Sex: An Examination of Current Ideas, R.E. Michod and B.R. Levin, Eds., Sunderland: Sinauer Associates Inc., 1988, pp. 7-23.
  30. M. Clerc and J. Kennedy, "The Particle Swarm-Explosion, Stability, and Convergence in a Multidimensional Complex Space," IEEE Trans. Evolutionary Computation, vol. 6, 2002, pp. 58-73. https://doi.org/10.1109/4235.985692
  31. M. Mitchel, An Introduction to Genetic Algorithms, MIT Press, 1999.
  32. M. Dorigo and T. Stützle, Ant Colony Optimization, India, New Delhi: Prentice-Hall, 2005.
  33. http://www.norsys.com/networklibrary.html
  34. I.A. Beinlinch et al., "The ALARM Monitoring System: A Case Study with Two Probabilistic Inference Techniques for Belief Networks," Proc. 2nd European Conf. Artificial Intell. Medicine, 1989, pp. 247-256.

Cited by

  1. Parameter identification of bidirectional IPT system using chaotic asexual reproduction optimization vol.78, pp.3, 2014, https://doi.org/10.1007/s11071-014-1585-9
  2. Parameter extraction of solar cell models using chaotic asexual reproduction optimization vol.26, pp.5, 2011, https://doi.org/10.1007/s00521-014-1795-6
  3. A novel method for Bayesian networks structure learning based on Breeding Swarm algorithm vol.22, pp.9, 2011, https://doi.org/10.1007/s00500-017-2557-z
  4. Integrating expert knowledge for Bayesian network structure learning based on intuitionistic fuzzy set and Genetic Algorithm vol.23, pp.1, 2011, https://doi.org/10.3233/ida-183877
  5. ARP: asexual reproduction programming vol.33, pp.2, 2011, https://doi.org/10.1080/09540091.2020.1807465