• Title/Summary/Keyword: classifier evaluation

Search Result 147, Processing Time 0.026 seconds

Performance Evaluation of Rough Set Classifier (러프 집합 분류기의 성능 평가)

  • 류재홍;임창균
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1998.10a
    • /
    • pp.232-235
    • /
    • 1998
  • This paper evaluates the performance of a rough set based pattern classifier using the benchmarks in artificial neural nets depository found in internet. The definition of rough set in soft computing paradigm is briefly introduced. next the design of rough set classifier is suggested. Finally benchmark test results are shown the performance of rough set compare to that of ANNs and decision tree.

  • PDF

Optimization of Classifier Performance at Local Operating Range: A Case Study in Fraud Detection

  • Park Lae-Jeong;Moon Jung-Ho
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.5 no.3
    • /
    • pp.263-267
    • /
    • 2005
  • Building classifiers for financial real-world classification problems is often plagued by severely overlapping and highly skewed class distribution. New performance measures such as receiver operating characteristic (ROC) curve and area under ROC curve (AUC) have been recently introduced in evaluating and building classifiers for those kind of problems. They are, however, in-effective to evaluation of classifier's discrimination performance in a particular class of the classification problems that interests lie in only a local operating range of the classifier, In this paper, a new method is proposed that enables us to directly improve classifier's discrimination performance at a desired local operating range by defining and optimizing a partial area under ROC curve or domain-specific curve, which is difficult to achieve with conventional classification accuracy based learning methods. The effectiveness of the proposed approach is demonstrated in terms of fraud detection capability in a real-world fraud detection problem compared with the MSE-based approach.

A Study on Application of the Multi-layor Perceptron to the Human Sensibility Classifier with Eletroencephalogram (뇌파의 감성 분류기로서 다층 퍼셉트론의 활용에 관한 연구)

  • Kim, Dong Jun
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.67 no.11
    • /
    • pp.1506-1511
    • /
    • 2018
  • This study presents a human sensibility evaluation method using neural network and multiple-template method on electroencephalogram(EEG). We used a multi-layer perceptron type neural network as the sensibility classifier using EEG signal. For our research objective, 10-channel EEG signals are collected from the healthy subjects. After the necessary preprocessing is performed on the acquired signals, the various EEG parameters are estimated and their discriminating performance is evaluated in terms of pattern classification capability. In our study, Linear Prediction(LP) coefficients are utilized as the feature parameters extracting the characteristics of EEG signal, and a multi-layer neural network is used for indicating the degree of human sensibility. Also, the estimation for human comfortableness is performed by varying temperature and humidity environment factors and our results showed that the proposed scheme achieved good performances for evaluation of human sensibility.

Multi-classifier Fusion Based Facial Expression Recognition Approach

  • Jia, Xibin;Zhang, Yanhua;Powers, David;Ali, Humayra Binte
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.8 no.1
    • /
    • pp.196-212
    • /
    • 2014
  • Facial expression recognition is an important part in emotional interaction between human and machine. This paper proposes a facial expression recognition approach based on multi-classifier fusion with stacking algorithm. The kappa-error diagram is employed in base-level classifiers selection, which gains insights about which individual classifier has the better recognition performance and how diverse among them to help improve the recognition accuracy rate by fusing the complementary functions. In order to avoid the influence of the chance factor caused by guessing in algorithm evaluation and get more reliable awareness of algorithm performance, kappa and informedness besides accuracy are utilized as measure criteria in the comparison experiments. To verify the effectiveness of our approach, two public databases are used in the experiments. The experiment results show that compared with individual classifier and two other typical ensemble methods, our proposed stacked ensemble system does recognize facial expression more accurately with less standard deviation. It overcomes the individual classifier's bias and achieves more reliable recognition results.

Accuracy Comparison of Motor Imagery Performance Evaluation Factors Using EEG Based Brain Computer Interface by Neurofeedback Effectiveness (뉴로피드백 효과에 따른 EEG 기반 BCI 동작 상상 성능 평가 요소별 정확도 비교)

  • Choi, Dong-Hag;Ryu, Yon-Su;Lee, Young-Bum;Min, Se-Dong;Lee, Myoung-Ho
    • Journal of Biomedical Engineering Research
    • /
    • v.32 no.4
    • /
    • pp.295-304
    • /
    • 2011
  • In this study, we evaluated the EEG based BCI algorithm using common spatial pattern to find realistic applicability using neurofeedback EEG based BCI algorithm - EEG mode, feature vector calculation, the number of selected channels, 3 types of classifier, window size is evaluated for 10 subjects. The experimental results have been evaluated depending on conditioned experiment whether neurofeedback is used or not In case of using neurofeedback, a few subjects presented exceptional but general tendency presented the performance improvement Through this study, we found a motivation of development for the specific classifier based BCI system and the assessment evaluation system. We proposed a need for an optimized algorithm applicable to the robust motor imagery evaluation system with more useful functionalities.

A Comparative Study of Phishing Websites Classification Based on Classifier Ensemble

  • Tama, Bayu Adhi;Rhee, Kyung-Hyune
    • Journal of Korea Multimedia Society
    • /
    • v.21 no.5
    • /
    • pp.617-625
    • /
    • 2018
  • Phishing website has become a crucial concern in cyber security applications. It is performed by fraudulently deceiving users with the aim of obtaining their sensitive information such as bank account information, credit card, username, and password. The threat has led to huge losses to online retailers, e-business platform, financial institutions, and to name but a few. One way to build anti-phishing detection mechanism is to construct classification algorithm based on machine learning techniques. The objective of this paper is to compare different classifier ensemble approaches, i.e. random forest, rotation forest, gradient boosted machine, and extreme gradient boosting against single classifiers, i.e. decision tree, classification and regression tree, and credal decision tree in the case of website phishing. Area under ROC curve (AUC) is employed as a performance metric, whilst statistical tests are used as baseline indicator of significance evaluation among classifiers. The paper contributes the existing literature on making a benchmark of classifier ensembles for web phishing detection.

Efficient Implementing of DNA Computing-inspired Pattern Classifier Using GPU (GPU를 이용한 DNA 컴퓨팅 기반 패턴 분류기의 효율적 구현)

  • Choi, Sun-Wook;Lee, Chong-Ho
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.58 no.7
    • /
    • pp.1424-1434
    • /
    • 2009
  • DNA computing-inspired pattern classification based on the hypernetwork model is a novel approach to pattern classification problems. The hypernetwork model has been shown to be a powerful tool for multi-class data analysis. However, the ordinary hypernetwork model has limitations, such as operating sequentially only. In this paper, we propose a efficient implementing method of DNA computing-inspired pattern classifier using GPU. We show simulation results of multi-class pattern classification from hand-written digit data, DNA microarray data and 8 category scene data for performance evaluation. and we also compare of operation time of the proposed DNA computing-inspired pattern classifier on each operating environments such as CPU and GPU. Experiment results show competitive diagnosis results over other conventional machine learning algorithms. We could confirm the proposed DNA computing-inspired pattern classifier, designed on GPU using CUDA platform, which is suitable for multi-class data classification. And its operating speed is fast enough to comply point-of-care diagnostic purpose and real-time scene categorization and hand-written digit data classification.

A Novel Method for a Reliable Classifier using Gradients

  • Han, Euihwan;Cha, Hyungtai
    • IEIE Transactions on Smart Processing and Computing
    • /
    • v.6 no.1
    • /
    • pp.18-20
    • /
    • 2017
  • In this paper, we propose a new classification method to complement a $na{\ddot{i}}ve$ Bayesian classifier. This classifier assumes data distribution to be Gaussian, finds the discriminant function, and derives the decision curve. However, this method does not investigate finding the decision curve in much detail, and there are some minor problems that arise in finding an accurate discriminant function. Our findings also show that this method could produce errors when finding the decision curve. The aim of this study has therefore been to investigate existing problems and suggest a more reliable classification method. To do this, we utilize the gradient to find the decision curve. We then compare/analyze our algorithm with the $na{\ddot{i}}ve$ Bayesian method. Performance evaluation indicates that the average accuracy of our classification method is about 10% higher than $na{\ddot{i}}ve$ Bayes.

Modulation classification for BPSK and QPSK signals over rayleigh fading channel (Payleigh 페이딩 채널에서 BPSK와 QPSK 신호의 변조 분류)

  • 윤동원;한영열
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.21 no.4
    • /
    • pp.1019-1026
    • /
    • 1996
  • A modulation type classifier based on statistical moments has been successfully employed to classify PSK signals. Previously, developed Classifiers were analyzed in AWGN channel only. In this paper, a moments-based modulation type classifier to classify BPSK and QPSK signals over Rayleigh fading channel is proposed and analyzed. The moments of received signal are evaluated with the exact distribution of the received signal and a moments-based classifier is proposed. The performance evaluation of the proposed classifier in terms of the misclassification probability for BPSK and QPSK is investigated under Rayleigh fading environment.

  • PDF

Classification of Welding Defects in Austenitic Stainless Steel by Neural Pattern Recognition of Ultrasonic Signal (초음파신호의 신경망 형상인식법을 이용한 오스테나이트 스테인레스강의 용접부결함 분류에 관한 연구)

  • Lee, Gang-Yong;Kim, Jun-Seop
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.20 no.4
    • /
    • pp.1309-1319
    • /
    • 1996
  • The research for the classification of the natural defects in welding zone is performd using the neuro-pattern recognition technology. The signal pattern recognition package including the user's defined function is developed to perform the digital signal processing, feature extraction, feature selection and classifier selection, The neural network classifier and the statistical classifiers such as the linear discriminant function classifier and the empirical Bayesian calssifier are compared and discussed. The neuro-pattern recognition technique is applied to the classificaiton of such natural defects as root crack, incomplete penetration, lack of fusion, slag inclusion, porosity, etc. If appropriately learned, the neural network classifier is concluded to be better than the statistical classifiers in the classification of the natural welding defects.