• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2003.05a
• /
• pp.182-185
• /
• 2003

This paper presents a new design algorithm for the combination with the fuzzy classifier and the Bayesian classifier. Only few attempts have so far been made at providing an effective design algorithm combining the advantages and removing the disadvantages of two classifiers. Specifically, the suggested algorithms are composed of three steps: the combining, the fuzzy-set-based pruning, and the fuzzy set tuning. In the combining, the multi-inputs and multi-outputs (MIMO) fuzzy model is used to combine two classifiers. In the fuzzy-set-based pruning, to effectively decrease the complexity of the fuzzy-Bayesian classifier and the risk of the overfitting, the analysis method of the fuzzy set and the recursive pruning method are proposesd. In the fuzzy set tuning for the misclassified feature vectors, the premise parameters are adjusted by using the gradient decent algorithm. Finally, to show the feasibility and the validity of the proposed algorithm, a computer simulation is provided.

• Journal of KIISE:Software and Applications
• /
• v.29 no.8
• /
• pp.595-603
• /
• 2002

Only a few studies have been conducted on how to select multiple classifiers from the pool of available classifiers for showing the good classification performance. Thus, the selection problem if classifiers on how to select or how many to select still remains an important research issue. In this paper, provided that the number of selected classifiers is constrained in advance, a variety of selection criteria are proposed and applied to tile construction of multiple classifier systems, and then these selection criteria will be evaluated by the performance of the constructed multiple classifier systems. All the possible sets of classifiers are trammed by the selection criteria, and some of these sets are selected as the candidates of multiple classifier systems. The multiple classifier system candidates were evaluated by the experiments recognizing unconstrained handwritten numerals obtained both from Concordia university and UCI machine learning repository. Among the selection criteria, particularly the multiple classifier system candidates by the information-theoretic selection criteria based on conditional entropy showed more promising results than those by the other selection criteria.

• 제어로봇시스템학회:학술대회논문집
• /
• 2003.10a
• /
• pp.1272-1277
• /
• 2003

This paper presents a method for combining classifier which is constructed by fuzzy and neural network classifiers and uses classifier fusion algorithms and selection algorithms. The input space of combing classifier is divided by the extended hyperbox region proposed in this paper to guarantee non-overlapped data property. To fuse the fuzzy classifier and the neural network classifier, we propose the fusion parameter for the overlapped data. In addition, the adaptive learning algorithm also proposed to maximize classifier performance. Finally, simulation examples are given to illustrate the effectiveness of the method.

• Journal of Information Processing Systems
• /
• v.13 no.5
• /
• pp.1203-1212
• /
• 2017

Intrusion detection systems (IDSs) are crucial in this overwhelming increase of attacks on the computing infrastructure. It intelligently detects malicious and predicts future attack patterns based on the classification analysis using machine learning and data mining techniques. This paper is devoted to thoroughly evaluate classifier ensembles for IDSs in IEEE 802.11 wireless network. Two ensemble techniques, i.e. voting and stacking are employed to combine the three base classifiers, i.e. decision tree (DT), random forest (RF), and support vector machine (SVM). We use area under ROC curve (AUC) value as a performance metric. Finally, we conduct two statistical significance tests to evaluate the performance differences among classifiers.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.12 no.4
• /
• pp.289-293
• /
• 2002

Learning Classifier System (LCS) finds a new rule set using genetic algorithm (GA). In this paper, The Zeroth Level Classifier System (ZCS) is applied to evolving the strategy of a robot soccer simulation game (SimuroSot), which is a state varying dynamical system changed over time, as GBML (Genetic Based Machine Learning) and we show the effectiveness of the proposed scheme through the simulation of robot soccer.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.9 no.7
• /
• pp.2683-2702
• /
• 2015

A Content-based Image Retrieval (CBIR) system employs visual features rather than manual annotation of images. The selection of optimal features used in classification of images plays a key role in its performance. Category proliferation problem has a huge impact on performance of systems using Fuzzy Artmap (FAM) classifier. The proposed CBIR system uses a modified version of FAM called Non-Proliferation Fuzzy Artmap (NPFAM). This is developed by introducing significant changes in the learning process and the modified algorithm is evaluated by extensive experiments. Results have proved that NPFAM classifier generates a more compact rule set and performs better than FAM classifier. Accordingly, the CBIR system with NPFAM classifier yields good retrieval.

• Journal of Institute of Control, Robotics and Systems
• /
• v.16 no.1
• /
• pp.96-100
• /
• 2010

This paper proposes novel genetic design of optimal classifier ensemble for vehicle detection using Genetic Algorithm with Varying Population Size (GAVaPS). Recently, many classifiers are used in classifier ensemble to deal with tremendous amounts of data. However the problem has a exponential large search space due to the increasing the number of classifier pool. To solve this problem, we employ the GAVaPS which outperforms comparison with simple genetic algorithm (SGA). Experiments are performed to demonstrate the efficiency of the proposed method.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2000.05a
• /
• pp.179-182
• /
• 2000

A Classifier System processes a discrete coded information from the environment. When the system codes the information to discontinuous data, it loses excessively the information of the environment. The Fuzzy Classifier System(FCS) makes the classifier system be able to carry out the mapping from continuous inputs to outputs. It is the FCS that applies this ability of the machine learning to the concept of fuzzy controller. It is that the antecedent and consequent of classifier is same as a fuzzy rule of the rule base. In this paper, the FCS is the Michigan style and fuzzifies the input values to create the messages. The system stores those messages in the message list and uses the implicit Bucket Brigade Algorithms. Also the FCS employs the Genetic Algorithms(GAs) to make new rules and modify rules when performance of the system needs to be improved. We will verify the effectiveness of the proposed FCS by applying it to AMR avoiding the obstacle.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.5 no.3
• /
• pp.263-267
• /
• 2005

Building classifiers for financial real-world classification problems is often plagued by severely overlapping and highly skewed class distribution. New performance measures such as receiver operating characteristic (ROC) curve and area under ROC curve (AUC) have been recently introduced in evaluating and building classifiers for those kind of problems. They are, however, in-effective to evaluation of classifier's discrimination performance in a particular class of the classification problems that interests lie in only a local operating range of the classifier, In this paper, a new method is proposed that enables us to directly improve classifier's discrimination performance at a desired local operating range by defining and optimizing a partial area under ROC curve or domain-specific curve, which is difficult to achieve with conventional classification accuracy based learning methods. The effectiveness of the proposed approach is demonstrated in terms of fraud detection capability in a real-world fraud detection problem compared with the MSE-based approach.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 1995.10b
• /
• pp.11-14
• /
• 1995

A Fuzzy Classifier which deals with very confusing objects is proposed. Naturally this classifier heavily relies on the nulti-feature decision-making procedure. For a simple example, this classifier is applied to the recognition of confusing handwritten numerals 4,6 and 9 The characteristic variables used in this paper are the existence of a loop and the relative location of the starting or ending points(SEP). Thus each sample of handwritten numerals 4, 6 and 9 is classified in one of the 6 groups which are divided according to the sample structure. Each group has its own classifying rules. Also the method of rule-generation using genetic algorithms in each group is proposed.