• Title/Summary/Keyword: Bayes

Search Result 925, Processing Time 0.025 seconds

A Study on Incremental Learning Model for Naive Bayes Text Classifier (Naive Bayes 문서 분류기를 위한 점진적 학습 모델 연구)

  • 김제욱;김한준;이상구
    • Proceedings of the Korea Database Society Conference
    • /
    • 2001.06a
    • /
    • pp.331-341
    • /
    • 2001
  • 본 논문에서는 Naive Bayes 문서 분류기를 위한 새로운 학습모델을 제안한다. 이 모델에서는 라벨이 없는 문서들의 집합으로부터 선택한 적은 수의 학습 문서들을 이용하여 문서 분류기를 재학습한다. 본 논문에서는 이러한 학습 방법을 따를 경우 작은 비용으로도 문서 분류기의 정확도가 크게 향상될 수 있다는 사실을 보인다. 이와 같이, 알고리즘을 통해 라벨이 없는 문서들의 집합으로부터 정보량이 큰 문서를 선택한 후, 전문가가 이 문서에 라벨을 부여하는 방식으로 학습문서를 결정하는 것을 selective sampling이라 한다. 본 논문에서는 이러한 selective sampling 문제를 Naive Bayes 문서 분류기에 적용한다. 제안한 학습 방법에서는 라벨이 없는 문서들의 집합으로부터 재학습 문서를 선택하는 기준 측정치로서 평균절대편차(Mean Absolute Deviation), 엔트로피 측정치를 사용한다. 실험을 통해서 제안한 학습 방법이 기존의 방법인 신뢰도(Confidence measure)를 이용한 학습 방법보다 Naive Bayes 문서 분류기의 성능을 더 많이 향상시킨다는 사실을 보인다.

  • PDF

A Novel Posterior Probability Estimation Method for Multi-label Naive Bayes Classification

  • Kim, Hae-Cheon;Lee, Jaesung
    • Journal of the Korea Society of Computer and Information
    • /
    • v.23 no.6
    • /
    • pp.1-7
    • /
    • 2018
  • A multi-label classification is to find multiple labels associated with the input pattern. Multi-label classification can be achieved by extending conventional single-label classification. Common extension techniques are known as Binary relevance, Label powerset, and Classifier chains. However, most of the extended multi-label naive bayes classifier has not been able to accurately estimate posterior probabilities because it does not reflect the label dependency. And the remaining extended multi-label naive bayes classifier has a problem that it is unstable to estimate posterior probability according to the label selection order. To estimate posterior probability well, we propose a new posterior probability estimation method that reflects the probability between all labels and labels efficiently. The proposed method reflects the correlation between labels. And we have confirmed through experiments that the extended multi-label naive bayes classifier using the proposed method has higher accuracy then the existing multi-label naive bayes classifiers.

A Study on the Application of Constrained Bayes Estimation for Product Quality Control (Constrained 베이즈 추정방식의 제품 품질관리 활용방안에 관한 연구)

  • Kim, Tai-Kyoo;Kim, Myung Joon
    • Journal of Korean Society for Quality Management
    • /
    • v.43 no.1
    • /
    • pp.57-66
    • /
    • 2015
  • Purpose: The purpose of this study is to apply the constrained Bayesian estimation methodology for product quality control process and prove the effectiveness of the product management by comparing with the well-known Bayes estimator through data performance result. Methods: The Bayes and constrained Bayes estimators were produced based on the theoretical background and for confirming the effectiveness of suggested application, the deviation index was defined and calculated for the comparison. Results: The statistical analysis result shows that applying the suggested estimation methodology, that is, constrained Bayes estimator improves the effectiveness of the index with regard to reduce the error by matching the first two empirical moments. Conclusion: Considering the advanced Bayesian approaches such as constrained Bayes estimation for the product quality control process, the newly defined deviation index reduces the error for estimating the parameter histogram which is reflected both location and deviation parameters and furthermore various Bayesian perspective approaches seems to be meaningful for managing the product quality control process.

Moving Object Tracking in Active Camera Environment Based on Bayes Decision Theory (Bayes 결정이론에 기반을 둔 능동카메라 환경에서의 이동 물체의 검출 및 추적)

  • 배수현;강문기
    • Journal of Broadcast Engineering
    • /
    • v.4 no.1
    • /
    • pp.22-31
    • /
    • 1999
  • Moving object tracking improves the efficiency and qualification for observation system, broadcasting system, video conference, etc. This paper propcses an improved Bayes decision method for detecting and tracking moving objects in active camera environment. The Bayes decision based tracking approach finds the region of moving objects by analyzing the image sequences statistically. The propcsed algorithm regenerates the probability density function to accord with moving objects and background for active camera. Experimental results show that the algorithm is accurate. reliable and noise resistant. The result is compared with those of the conventional methods.

  • PDF

Naive Bayes Learning Algorithm based on Map-Reduce Programming Model (Map-Reduce 프로그래밍 모델 기반의 나이브 베이스 학습 알고리즘)

  • Kang, Dae-Ki
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2011.10a
    • /
    • pp.208-209
    • /
    • 2011
  • In this paper, we introduce a Naive Bayes learning algorithm for learning and reasoning in Map-Reduce model based environment. For this purpose, we use Apache Mahout to execute Distributed Naive Bayes on University of California, Irvine (UCI) benchmark data sets. From the experimental results, we see that Apache Mahout' s Distributed Naive Bayes algorithm is comparable to WEKA' s Naive Bayes algorithm in terms of performance. These results indicates that in the future Big Data environment, Map-Reduce model based systems such as Apache Mahout can be promising for machine learning usage.

  • PDF

Development and evaluation of dam inflow prediction method based on Bayesian method (베이지안 기법 기반의 댐 예측유입량 산정기법 개발 및 평가)

  • Kim, Seon-Ho;So, Jae-Min;Kang, Shin-Uk;Bae, Deg-Hyo
    • Journal of Korea Water Resources Association
    • /
    • v.50 no.7
    • /
    • pp.489-502
    • /
    • 2017
  • The objective of this study is to propose and evaluate the BAYES-ESP, which is a dam inflow prediction method based on Ensemble Streamflow Prediction method (ESP) and Bayesian theory. ABCD rainfall-runoff model was used to predict monthly dam inflow. Monthly meteorological data collected from KMA, MOLIT and K-water and dam inflow data collected from K-water were used for the model calibration and verification. To estimate the performance of ABCD model, ESP and BAYES-ESP method, time series analysis and skill score (SS) during 1986~2015 were used. In time series analysis monthly ESP dam inflow prediction values were nearly similar for every years, particularly less accurate in wet and dry years. The proposed BAYES-ESP improved the performance of ESP, especially in wet year. The SS was used for quantitative analysis of monthly mean of observed dam inflows, predicted values from ESP and BAYES-ESP. The results indicated that the SS values of ESP were relatively high in January, February and March but negative values in the other months. It also showed that the BAYES-ESP improved ESP when the values from ESP and observation have a relatively apparent linear relationship. We concluded that the existing ESP method has a limitation to predict dam inflow in Korea due to the seasonality of precipitation pattern and the proposed BAYES-ESP is meaningful for improving dam inflow prediction accuracy of ESP.

Bayes Stopping Rule for MAC Scheme Wireless Sensor Networks (무선 센서 망에서 MAC 방식을 위한 Bayes 중지 규칙)

  • Park, Jin-Kyung;Choi, Cheon-Won
    • Journal of the Institute of Electronics Engineers of Korea TC
    • /
    • v.45 no.7
    • /
    • pp.53-61
    • /
    • 2008
  • Consider a typical wireless sensor network in which stem nodes form the backbone network of mesh topology while each stem node together with leaf nodes in its vicinity forms a subnetwork of star topology. In such a wireless sensor network, we must heed the following when we design a MAC scheme supporting the packet delivery from a leaf node to a stem node. First, leaf nodes are usually battery-powered and it is difficult to change or recharge their batteries. Secondly, a wireless sensor network is often deployed to collect and update data periodically. Late delivery of a data segment by a sensor node causes the sink node to defer data processing and the data segment itself to be obsolete. Thirdly, extensive signaling is extremely limited and complex computation is hardly supported. Taking account of these facts, a MAC scheme must be able to save energy and support timeliness in packet delivery while being simple and robust as well. In this paper, we propose a version of ALOHA as a MAC scheme for a wireless sensor network. While conserving the simplicity and robustness of the original version of ALOHA, the proposed version of ALOHA possesses a distinctive feature that a sensor node decides between stop and continuation prior to each delivery attempt for a packet. Such a decision needs a stopping rule and we suggest a Bayes stopping rule. Note that a Bayes stopping rule minimizes the Bayes risk which reflects the energy, timeliness and throughput losses. Also, a Bayes stopping rule is practical since a sensor node makes a decision only using its own history of delivery attempt results and the prior information about the failure in delivery attempt. Numerical examples confirm that the proposed version of ALOHA employing a Bayes stopping rule is a useful MAC scheme in the severe environment of wireless sensor network.

An Empiricla Bayes Estimation of Multivariate nNormal Mean Vector

  • Kim, Hea-Jung
    • Journal of the Korean Statistical Society
    • /
    • v.15 no.2
    • /
    • pp.97-106
    • /
    • 1986
  • Assume that $X_1, X_2, \cdots, X_N$ are iid p-dimensional normal random vectors ($p \geq 3$) with unknown covariance matrix. The problem of estimating multivariate normal mean vector in an empirical Bayes situation is considered. Empirical Bayes estimators, obtained by Bayes treatmetn of the covariance matrix, are presented. It is shown that the estimators are minimax, each of which domainates teh maximum likelihood estimator (MLE), when the loss is nonsingular quadratic loss. We also derive approximate credibility region for the mean vector that takes advantage of the fact that the MLE is not the best estimator.

  • PDF

Bayes Estimation for the Rayleigh Failure Model

  • Ko, Jeong-Hwan;Kang, Sang-Gil;Shin, Jae-Kyoung
    • Journal of the Korean Data and Information Science Society
    • /
    • v.9 no.2
    • /
    • pp.227-235
    • /
    • 1998
  • In this paper, we consider a hierarchical Bayes estimation of the parameter, the reliability and hazard rate function based on type-II censored samples from a Rayleigh failure model. Bayes calculations can be implemented easily by means of the Gibbs sampler. A numerical study is provided.

  • PDF

Estimation of the parameter in an Exponential Distribution using a LINEX Loss

  • Woo, Jung-Soo;Lee, Hwa-Jung;Eun, Kab-Sook
    • Journal of the Korean Data and Information Science Society
    • /
    • v.13 no.2
    • /
    • pp.1-10
    • /
    • 2002
  • A Bayes estimator of the scale parameter in an exponential distribution will be considered by a LINEX error, then the risk of the Bayes estimator using a LINEX loss will be compared with that of a Bayes estimator using a square error.

  • PDF