Browse > Article
http://dx.doi.org/10.5391/JKIIS.2008.18.1.032

Generation of Efficient Fuzzy Classification Rules Using Evolutionary Algorithm with Data Partition Evaluation  

Ryu, Joung-Woo (한국전자통신연구원 지능형로봇연구단)
Kim, Sung-Eun ((주)퓨쳐시스템 정보통신연구소)
Kim, Myung-Won (숭실대학원 컴퓨터학부)
Publication Information
Journal of the Korean Institute of Intelligent Systems / v.18, no.1, 2008 , pp. 32-40 More about this Journal
Abstract
Fuzzy rules are very useful and efficient to describe classification rules especially when the attribute values are continuous and fuzzy in nature. However, it is generally difficult to determine membership functions for generating efficient fuzzy classification rules. In this paper, we propose a method of automatic generation of efficient fuzzy classification rules using evolutionary algorithm. In our method we generate a set of initial membership functions for evolutionary algorithm by supervised clustering the training data set and we evolve the set of initial membership functions in order to generate fuzzy classification rules taking into consideration both classification accuracy and rule comprehensibility. To reduce time to evaluate an individual we also propose an evolutionary algorithm with data partition evaluation in which the training data set is partitioned into a number of subsets and individuals are evaluated using a randomly selected subset of data at a time instead of the whole training data set. We experimented our algorithm with the UCI learning data sets, the experiment results showed that our method was more efficient at average compared with the existing algorithms. For the evolutionary algorithm with data partition evaluation, we experimented with our method over the intrusion detection data of KDD'99 Cup, and confirmed that evaluation time was reduced by about 70%. Compared with the KDD'99 Cup winner, the accuracy was increased by 1.54% while the cost was reduced by 20.8%.
Keywords
fuzzy classification rule; evolutionary algorithm; data partition evaluation; membership function; supervised clustering;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Quinlan, J.R., "Improved use of continuous attributes in C4.5," Journal of Artificial Intelligence Research, 4, pp.77-90, 1996
2 M. W. Kim, J. W. Ryu, "Optimized Fuzzy Classification for Data Mining," Lecture Notes in Computer Science Vol. 2973, pp.582-593, 2004
3 J. Gomez, D. Dasgupta, "Evolving fuzzy classifiers for intrusion detection," International Proceedings of the IEEE Workshop on Information Assurance, 2002
4 Chi-Ho Tsang, S. Kwong and H. Wang, "Anomaly intrusion detection using multi-objective genetic fuzzy system and agent-based evolutionary computation framework," International Conference on Data Mining, pp.789-792, 2005
5 C. Elkan, "Results of the KDD'99 classifier learning," ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp.63-64, 2000
6 Hisao Ishibuchi, Yusuke Nojima, "Analysis of interpretability- accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning," International Journal of Approximate Reasoning 44, pp.4-31, 2007   DOI   ScienceOn
7 Hisao Ishibuchi, Takashi Yamamoto, "Effects of Three-Objective Genetic Rule Selection on the Generalization Ability of Fuzzy Rule-Based Systems," Lecture Notes in Computer Science, Vol. 2632, pp.608-622, 2003
8 Hisao Ishibuchi, "Evolutionary Multiobjective Design of Fuzzy Rule-Based Systems," Proceeding of the 2007 IEEE Symposium on Foundations of Computational Intelligence, pp.9-16, 2007
9 http://www.ics.uci.edu/~mlearn/MLRepository.html
10 X.-Z. Wang, D.S. Yeung, E.C.C. Tsang, "A Comparative Study on Heuristic Algorithms for Generating Fuzzy Decision Trees," IEEE Transactions on Systems, Man, and Cybernetics, Vol. 31, NO. 2, pp. 215-226, 2001   DOI   ScienceOn
11 J. Abonyi, J. Roubos, F. Szeifert, "Data-driven generation of compact, accurate, and linguistically sound fuzzy classifiers based on a decision-tree initialization," International Journal of Approximate Reasoning, 31(1), pp.1-21, 2003   DOI
12 KDD Cup 1999 data set, http://kdd.ics.uci.edu/databases/kddcup99/ kddcup99.html, The UCI KDD Archive, University of California
13 Janikow, C.Z., Fajfer, M., "Fuzzy partitioning with FID3.1," 18th International Conference of the North American, NAFIPS, pp.467-471, 1999
14 Tomoharu Nakashima, Gaku Nakai, Hisao Ishibuchi, "Improving the Performance of Fuzzy Classification Systems by Membership Function Learning and Feature Selection," FUZZ-IEEE '02 Proceedings of the 2002 International Conference on Vol.1, pp.488-493, 2002
15 Tomoharu Nakashima, Gerald Schaefer, Yasuyuki Yokota, Hisao Ishibuchi, "A weighted fuzzy classifier and its application to image processing tasks," Fuzzy Sets and Systems 158, pp.284-294, 2007   DOI   ScienceOn
16 J. Roubos, M. Setnes, J. Abonyi, "Learning Fuzzy Classification Rules from Labeled Data," International Journal of Information Sciences, 150(1-2), pp.77-93, 2003   DOI   ScienceOn