Browse > Article
http://dx.doi.org/10.3745/KIPSTB.2007.14-B.5.369

Hybrid Genetic Algorithm for Classifier Ensemble Selection  

Kim, Young-Won (한국전자통신연구원 우정기술연구센터)
Oh, Il-Seok (전북대학교 전자정보공학부)
Publication Information
The KIPS Transactions:PartB / v.14B, no.5, 2007 , pp. 369-376 More about this Journal
Abstract
This paper proposes a hybrid genetic algorithm(HGA) for the classifier ensemble selection. HGA is added a local search operation for increasing the fine-turning of local area. This paper apply hybrid and simple genetic algorithms(SGA) to the classifier ensemble selection problem in order to show the superiority of HGA. And this paper propose two methods(SSO: Sequential Search Operations, CSO: Combinational Search Operations) of local search operation of hybrid genetic algorithm. Experimental results show that the HGA has better searching capability than SGA. The experiments show that the CSO considering the correlation among classifiers is better than the SSO.
Keywords
Classifier Ensemble; Classifier Selection; Hybrid Genetic Algorithm;
Citations & Related Records
연도 인용수 순위
  • Reference
1 N. Ueda, 'Optimal linear combination of neural networks for improving classification performance,' IEEE Tr. Pattern Analysis and Machine Intelligence, Vol.22, No.2, pp.207-215, 2000   DOI   ScienceOn
2 L. Breiman, 'Bagging predictors,' Machine Learning, Vol.24, No.2, pp.123-140, 1996   DOI
3 Robert Bryll, Ricardo Gutierrez-Osuna, and Francis Quek, 'Attribute bagging: improving accuracy of classifier ensembles by using random feature subsets,' Pattern Recognition, Vol.36, No.6, pp.1291-1302, 2003   DOI   ScienceOn
4 J. R. Quinlan, 'Bagging, boosting, and C4.5,' Proc. AAAI-96, pp.725-730, 1996
5 Tin Kam Ho, 'Multiple classifier combination: lessons and next steps,' in Hybrid Methods in Pattern Recognition, (Ed. by H. Bubke & A. Kandel), World Scientific, 2002
6 P.M. Granitto, P.F. Verdes, and H.A. Ceccatto, 'Neural network ensembles: evaluation of aggregation algorithms,' Artificial Intelligence, Vol.163, No.2, pp.139-162, 2005   DOI   ScienceOn
7 Chanho Park and Sung-Bae Cho, 'EVolutionary ensemble classifier for lymphoma and colon cancer classification,' Proc. of IEEE International Conf. on EVolutionary Computation, Vol.4, pp.2378-2385, 2003   DOI
8 S. Wesolkowski and K. Hassanein, 'A comparative study of combination schemes for an ensemble of digit recognition neural networks,' Proc. of IEEE International Conf. on Computational Cybernetics and Simulation. Vol.4, pp.3534-3539, 1997   DOI
9 Zhi-Hua Zhou, Jianxin Wu, and Wei Tang, 'Ensembling neural networks: many could be better than all,' Artificial Intelligence, Vol.137, pp.239-263, 2002   DOI   ScienceOn
10 J. Kittler, M. Hatef, R.P.W. Duin, and J. Matas, 'On combining classifiers,' IEEE Tr. Pattern Analysis and Machine Intelligence, Vol.20, No.3, pp.226-239, 1998   DOI   ScienceOn
11 G. Fumera and F. Roli, 'A theoretical and experimental analysis of linear combiners for multiple classifier systems,' IEEE Tr. Pattern Analysis and Machine Intelligence, Vol.27, No.6, pp.942-956, 2005   DOI   ScienceOn
12 Il-Seok Oh, jin-Seon Lee, and Byung-Ro Moon, 'Hybrid genetic algorithms for feature selection,' IEEE Tr. Pattern Analysis and Machine Intelligence, Vol.26, No.11, pp.1424-1437, 2004   DOI   ScienceOn
13 P. Jog, J. Suh, and D. Gucht, 'The effect of population size, heuristic crossover and local improvement on a genetic algorithm for the traveling salesman problem,' Proc. of International Conference on Genetic Algorithms, pp.110-115, 1989
14 T.N. Bui and B.R. Moon, 'Genetic algorithm and graph partitioning,' IEEE Tr. Computers, Vol.45, No.7, pp.841-855, 1996   DOI   ScienceOn
15 X. Zheng, B.A. Julstrom, and W. Cheng, 'Design of vector quantization codebooks using a genetic algorithm,' Proc. of IEEE International Conf. on EVolutionary Computation, pp.525-529, 1997   DOI
16 http://www.ics.uci.edu/~mlearn/databases/
17 G. Tremblay, R. Sabourin, and P. Maupin, 'Optimizing nearest neighbour in random subspaces using a multi-objective genetic algorithm,' In Proc. of 17th ICPR, Vol.1, pp.208-211, 2004   DOI
18 Antanas Verikas, Arunas Lipnickas, Kerstin Malmqvist, Marija Bacauskiene, and Adas Gelzinis, 'Soft combination of neural classifiers: a comparative study,' Pattern Recognition Letters, Vol.20, No.4, pp429-444, 1999   DOI   ScienceOn
19 Yifeng Zhang and Siddhartha Bhattacharyya, 'Genetic progranuning in classifying large-scale data: an ensemble method,' Information Sciences, Vol.163, pp.85-101, 2004   DOI   ScienceOn
20 Tin Kam Ho, 'The random subspace method for constructing decision forests,' IEEE Tr. Pattern Analysis and Machine Intelligence, Vol.20, No.8, pp.832-844, 1998   DOI   ScienceOn
21 Hee- Joong Kang and David Doermann, 'Selection of classifiers for the construction of multiple classifier systems,' Proc. of International Conf. on Document Analysis and Recognition, Vol.2, pp.1194-1198, 2005   DOI