• 제목/요약/키워드: classifier evaluation

검색결과 149건 처리시간 0.036초

러프 집합 분류기의 성능 평가 (Performance Evaluation of Rough Set Classifier)

  • 류재홍;임창균
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 1998년도 추계학술대회 학술발표 논문집
    • /
    • pp.232-235
    • /
    • 1998
  • This paper evaluates the performance of a rough set based pattern classifier using the benchmarks in artificial neural nets depository found in internet. The definition of rough set in soft computing paradigm is briefly introduced. next the design of rough set classifier is suggested. Finally benchmark test results are shown the performance of rough set compare to that of ANNs and decision tree.

  • PDF

Optimization of Classifier Performance at Local Operating Range: A Case Study in Fraud Detection

  • Park Lae-Jeong;Moon Jung-Ho
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제5권3호
    • /
    • pp.263-267
    • /
    • 2005
  • Building classifiers for financial real-world classification problems is often plagued by severely overlapping and highly skewed class distribution. New performance measures such as receiver operating characteristic (ROC) curve and area under ROC curve (AUC) have been recently introduced in evaluating and building classifiers for those kind of problems. They are, however, in-effective to evaluation of classifier's discrimination performance in a particular class of the classification problems that interests lie in only a local operating range of the classifier, In this paper, a new method is proposed that enables us to directly improve classifier's discrimination performance at a desired local operating range by defining and optimizing a partial area under ROC curve or domain-specific curve, which is difficult to achieve with conventional classification accuracy based learning methods. The effectiveness of the proposed approach is demonstrated in terms of fraud detection capability in a real-world fraud detection problem compared with the MSE-based approach.

뇌파의 감성 분류기로서 다층 퍼셉트론의 활용에 관한 연구 (A Study on Application of the Multi-layor Perceptron to the Human Sensibility Classifier with Eletroencephalogram)

  • 김동준
    • 전기학회논문지
    • /
    • 제67권11호
    • /
    • pp.1506-1511
    • /
    • 2018
  • This study presents a human sensibility evaluation method using neural network and multiple-template method on electroencephalogram(EEG). We used a multi-layer perceptron type neural network as the sensibility classifier using EEG signal. For our research objective, 10-channel EEG signals are collected from the healthy subjects. After the necessary preprocessing is performed on the acquired signals, the various EEG parameters are estimated and their discriminating performance is evaluated in terms of pattern classification capability. In our study, Linear Prediction(LP) coefficients are utilized as the feature parameters extracting the characteristics of EEG signal, and a multi-layer neural network is used for indicating the degree of human sensibility. Also, the estimation for human comfortableness is performed by varying temperature and humidity environment factors and our results showed that the proposed scheme achieved good performances for evaluation of human sensibility.

Multi-classifier Fusion Based Facial Expression Recognition Approach

  • Jia, Xibin;Zhang, Yanhua;Powers, David;Ali, Humayra Binte
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제8권1호
    • /
    • pp.196-212
    • /
    • 2014
  • Facial expression recognition is an important part in emotional interaction between human and machine. This paper proposes a facial expression recognition approach based on multi-classifier fusion with stacking algorithm. The kappa-error diagram is employed in base-level classifiers selection, which gains insights about which individual classifier has the better recognition performance and how diverse among them to help improve the recognition accuracy rate by fusing the complementary functions. In order to avoid the influence of the chance factor caused by guessing in algorithm evaluation and get more reliable awareness of algorithm performance, kappa and informedness besides accuracy are utilized as measure criteria in the comparison experiments. To verify the effectiveness of our approach, two public databases are used in the experiments. The experiment results show that compared with individual classifier and two other typical ensemble methods, our proposed stacked ensemble system does recognize facial expression more accurately with less standard deviation. It overcomes the individual classifier's bias and achieves more reliable recognition results.

뉴로피드백 효과에 따른 EEG 기반 BCI 동작 상상 성능 평가 요소별 정확도 비교 (Accuracy Comparison of Motor Imagery Performance Evaluation Factors Using EEG Based Brain Computer Interface by Neurofeedback Effectiveness)

  • 최동학;류연수;이영범;민세동;이명호
    • 대한의용생체공학회:의공학회지
    • /
    • 제32권4호
    • /
    • pp.295-304
    • /
    • 2011
  • In this study, we evaluated the EEG based BCI algorithm using common spatial pattern to find realistic applicability using neurofeedback EEG based BCI algorithm - EEG mode, feature vector calculation, the number of selected channels, 3 types of classifier, window size is evaluated for 10 subjects. The experimental results have been evaluated depending on conditioned experiment whether neurofeedback is used or not In case of using neurofeedback, a few subjects presented exceptional but general tendency presented the performance improvement Through this study, we found a motivation of development for the specific classifier based BCI system and the assessment evaluation system. We proposed a need for an optimized algorithm applicable to the robust motor imagery evaluation system with more useful functionalities.

A Comparative Study of Phishing Websites Classification Based on Classifier Ensemble

  • Tama, Bayu Adhi;Rhee, Kyung-Hyune
    • 한국멀티미디어학회논문지
    • /
    • 제21권5호
    • /
    • pp.617-625
    • /
    • 2018
  • Phishing website has become a crucial concern in cyber security applications. It is performed by fraudulently deceiving users with the aim of obtaining their sensitive information such as bank account information, credit card, username, and password. The threat has led to huge losses to online retailers, e-business platform, financial institutions, and to name but a few. One way to build anti-phishing detection mechanism is to construct classification algorithm based on machine learning techniques. The objective of this paper is to compare different classifier ensemble approaches, i.e. random forest, rotation forest, gradient boosted machine, and extreme gradient boosting against single classifiers, i.e. decision tree, classification and regression tree, and credal decision tree in the case of website phishing. Area under ROC curve (AUC) is employed as a performance metric, whilst statistical tests are used as baseline indicator of significance evaluation among classifiers. The paper contributes the existing literature on making a benchmark of classifier ensembles for web phishing detection.

GPU를 이용한 DNA 컴퓨팅 기반 패턴 분류기의 효율적 구현 (Efficient Implementing of DNA Computing-inspired Pattern Classifier Using GPU)

  • 최선욱;이종호
    • 전기학회논문지
    • /
    • 제58권7호
    • /
    • pp.1424-1434
    • /
    • 2009
  • DNA computing-inspired pattern classification based on the hypernetwork model is a novel approach to pattern classification problems. The hypernetwork model has been shown to be a powerful tool for multi-class data analysis. However, the ordinary hypernetwork model has limitations, such as operating sequentially only. In this paper, we propose a efficient implementing method of DNA computing-inspired pattern classifier using GPU. We show simulation results of multi-class pattern classification from hand-written digit data, DNA microarray data and 8 category scene data for performance evaluation. and we also compare of operation time of the proposed DNA computing-inspired pattern classifier on each operating environments such as CPU and GPU. Experiment results show competitive diagnosis results over other conventional machine learning algorithms. We could confirm the proposed DNA computing-inspired pattern classifier, designed on GPU using CUDA platform, which is suitable for multi-class data classification. And its operating speed is fast enough to comply point-of-care diagnostic purpose and real-time scene categorization and hand-written digit data classification.

A Novel Method for a Reliable Classifier using Gradients

  • Han, Euihwan;Cha, Hyungtai
    • IEIE Transactions on Smart Processing and Computing
    • /
    • 제6권1호
    • /
    • pp.18-20
    • /
    • 2017
  • In this paper, we propose a new classification method to complement a $na{\ddot{i}}ve$ Bayesian classifier. This classifier assumes data distribution to be Gaussian, finds the discriminant function, and derives the decision curve. However, this method does not investigate finding the decision curve in much detail, and there are some minor problems that arise in finding an accurate discriminant function. Our findings also show that this method could produce errors when finding the decision curve. The aim of this study has therefore been to investigate existing problems and suggest a more reliable classification method. To do this, we utilize the gradient to find the decision curve. We then compare/analyze our algorithm with the $na{\ddot{i}}ve$ Bayesian method. Performance evaluation indicates that the average accuracy of our classification method is about 10% higher than $na{\ddot{i}}ve$ Bayes.

Payleigh 페이딩 채널에서 BPSK와 QPSK 신호의 변조 분류 (Modulation classification for BPSK and QPSK signals over rayleigh fading channel)

  • 윤동원;한영열
    • 한국통신학회논문지
    • /
    • 제21권4호
    • /
    • pp.1019-1026
    • /
    • 1996
  • 이제까지 변조 분류에 대한 연구는 가산성 백색 가우시안 잡음에서만 해석되어 연구되어 왔다. 이 논문에서는 Rayleigh 페이딩 채널에서 통계적 모멘트에 근거한 BPSK와 QPSK 신호의 디지틀 변조 분류기를 제시하고 성능을 분석한다. 백색 가우시안 잡음과 Rayleigh 페이딩이 존재하는 환경에서 복조된 신호의 샘플 모멘트를 계산한다. 계산된 모멘트 값을 바탕으로 중심 극한 정리를 이용하여 샘플 모멘트의 평균과 분산을 계산한다. 이로부터 샘플 모멘트의 확률 밀도 함수를 구하고 베이즈 검정을 적용하여 통계적 모멘트에 기초한 BPSK와 QPSK 신호의 디지틀 변조 분류기를 제시하고 오분류 확률을 유도하여 성능을 분석한다.

  • PDF

초음파신호의 신경망 형상인식법을 이용한 오스테나이트 스테인레스강의 용접부결함 분류에 관한 연구 (Classification of Welding Defects in Austenitic Stainless Steel by Neural Pattern Recognition of Ultrasonic Signal)

  • 이강용;김준섭
    • 대한기계학회논문집A
    • /
    • 제20권4호
    • /
    • pp.1309-1319
    • /
    • 1996
  • The research for the classification of the natural defects in welding zone is performd using the neuro-pattern recognition technology. The signal pattern recognition package including the user's defined function is developed to perform the digital signal processing, feature extraction, feature selection and classifier selection, The neural network classifier and the statistical classifiers such as the linear discriminant function classifier and the empirical Bayesian calssifier are compared and discussed. The neuro-pattern recognition technique is applied to the classificaiton of such natural defects as root crack, incomplete penetration, lack of fusion, slag inclusion, porosity, etc. If appropriately learned, the neural network classifier is concluded to be better than the statistical classifiers in the classification of the natural welding defects.