• Title/Summary/Keyword: Posterior Probability Estimation

Search Result 37, Processing Time 0.027 seconds

A Novel Posterior Probability Estimation Method for Multi-label Naive Bayes Classification

  • Kim, Hae-Cheon;Lee, Jaesung
    • Journal of the Korea Society of Computer and Information
    • /
    • v.23 no.6
    • /
    • pp.1-7
    • /
    • 2018
  • A multi-label classification is to find multiple labels associated with the input pattern. Multi-label classification can be achieved by extending conventional single-label classification. Common extension techniques are known as Binary relevance, Label powerset, and Classifier chains. However, most of the extended multi-label naive bayes classifier has not been able to accurately estimate posterior probabilities because it does not reflect the label dependency. And the remaining extended multi-label naive bayes classifier has a problem that it is unstable to estimate posterior probability according to the label selection order. To estimate posterior probability well, we propose a new posterior probability estimation method that reflects the probability between all labels and labels efficiently. The proposed method reflects the correlation between labels. And we have confirmed through experiments that the extended multi-label naive bayes classifier using the proposed method has higher accuracy then the existing multi-label naive bayes classifiers.

Verification and estimation of a posterior probability and probability density function using vector quantization and neural network (신경회로망과 벡터양자화에 의한 사후확률과 확률 밀도함수 추정 및 검증)

  • 고희석;김현덕;이광석
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.45 no.2
    • /
    • pp.325-328
    • /
    • 1996
  • In this paper, we proposed an estimation method of a posterior probability and PDF(Probability density function) using a feed forward neural network and code books of VQ(vector quantization). In this study, We estimates a posterior probability and probability density function, which compose a new parameter with well-known Mel cepstrum and verificate the performance for the five vowels taking from syllables by NN(neural network) and PNN(probabilistic neural network). In case of new parameter, showed the best result by probabilistic neural network and recognition rates are average 83.02%.

  • PDF

Estimation of Geometric Mean for k Exponential Parameters Using a Probability Matching Prior

  • Kim, Hea-Jung;Kim, Dae Hwang
    • Communications for Statistical Applications and Methods
    • /
    • v.10 no.1
    • /
    • pp.1-9
    • /
    • 2003
  • In this article, we consider a Bayesian estimation method for the geometric mean of $textsc{k}$ exponential parameters, Using the Tibshirani's orthogonal parameterization, we suggest an invariant prior distribution of the $textsc{k}$ parameters. It is seen that the prior, probability matching prior, is better than the uniform prior in the sense of correct frequentist coverage probability of the posterior quantile. Then a weighted Monte Carlo method is developed to approximate the posterior distribution of the mean. The method is easily implemented and provides posterior mean and HPD(Highest Posterior Density) interval for the geometric mean. A simulation study is given to illustrates the efficiency of the method.

A Study on Maximum Posterior Probability Estimator for Direction of Arrival Estimation of Incoming Signal (입사신호의 도래방향 추정을 위한 최대 사후 확률 추정기에 대한 연구)

  • Lee, Kwan-Hyeong;Park, Sung-Kon;Jeong, Youn-Seo
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.9 no.2
    • /
    • pp.190-195
    • /
    • 2016
  • In this paper, we are comparative analysis both class method and proposal method in order to estimation of incident signal direction on uniform array antenna system. Proposal method of this paper decrease error probability for a signal direction of arrival estimation using maximum posterior probability estimator. If it decrease to signal estimation direction error probability, signal direction of arrival can correctly estimate. Through simulation, we were comparative analysis proposed method and class method. Also, we were comparative analysis about signal estimation error probability with increasing array antenna element. We show the superior performance of the proposed method relative to the class method to decrease of signal estimation error probability about 12%.

Posterior density estimation for structural parameters using improved differential evolution adaptive Metropolis algorithm

  • Zhou, Jin;Mita, Akira;Mei, Liu
    • Smart Structures and Systems
    • /
    • v.15 no.3
    • /
    • pp.735-749
    • /
    • 2015
  • The major difficulty of using Bayesian probabilistic inference for system identification is to obtain the posterior probability density of parameters conditioned by the measured response. The posterior density of structural parameters indicates how plausible each model is when considering the uncertainty of prediction errors. The Markov chain Monte Carlo (MCMC) method is a widespread medium for posterior inference but its convergence is often slow. The differential evolution adaptive Metropolis-Hasting (DREAM) algorithm boasts a population-based mechanism, which nms multiple different Markov chains simultaneously, and a global optimum exploration ability. This paper proposes an improved differential evolution adaptive Metropolis-Hasting algorithm (IDREAM) strategy to estimate the posterior density of structural parameters. The main benefit of IDREAM is its efficient MCMC simulation through its use of the adaptive Metropolis (AM) method with a mutation strategy for ensuring quick convergence and robust solutions. Its effectiveness was demonstrated in simulations on identifying the structural parameters with limited output data and noise polluted measurements.

Real-Time Motion Estimation Algorithm for Mobile Surveillance Robot (모바일 감시 로봇을 위한 실시간 움직임 추정 알고리즘)

  • Han, Cheol-Hoon;Sim, Kwee-Bo
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.19 no.3
    • /
    • pp.311-316
    • /
    • 2009
  • This paper presents the motion estimation algorithm on real-time for mobile surveillance robot using particle filter. the particle filter that based on the monte carlo's sampling method, use bayesian conditional probability model which having prior distribution probability and posterior distribution probability. However, the initial probability density was set to define randomly in the most of particle filter. In this paper, we find first the initial probability density using Sum of Absolute Difference(SAD). and we applied it in the partical filter. In result, more robust real-time estimation and tracking system on the randomly moving object was realized in the mobile surveillance robot environments.

A Study on Combined DoA Estimation Algorithm using LCMV and Maximum Posterior on Uniform Linear Array Antenna (균일 선형 배열 안테나에서 선형구속최소분산 방법과 사후 추정 확률을 결합한 도래 방향 추정 알고리즘 연구)

  • Lee, Kwan-Hyeong;Park, Sung-Kon;Jeong, Youn-Seo
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.9 no.3
    • /
    • pp.291-297
    • /
    • 2016
  • In this paper, we are comparative analysis of exit algorithm and proposal algorithm for desired target direction of arrival estimation in correlation signal system. Proposed algorithm in this paper is to decrease target direction of arrival an estimation error probability using bayesian, maximum posterior, and MUSIC algorithm in order to decrease direction of arrival error probability as optimize and use linear constrained minimum variance to update weight value. Through simulation, we were comparative analysis proposed algorithm and exit MUSIC algorithm. In case SNR is 10dB and antenna element arrays are 9 and 12, We show the superior performance of the proposed method relative to the class method to decrease of signal estimation error probability about 11% and 13%, respectively.

Feature Voting for Object Localization via Density Ratio Estimation

  • Wang, Liantao;Deng, Dong;Chen, Chunlei
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.13 no.12
    • /
    • pp.6009-6027
    • /
    • 2019
  • Support vector machine (SVM) classifiers have been widely used for object detection. These methods usually locate the object by finding the region with maximal score in an image. With bag-of-features representation, the SVM score of an image region can be written as the sum of its inside feature-weights. As a result, the searching process can be executed efficiently by using strategies such as branch-and-bound. However, the feature-weight derived by optimizing region classification cannot really reveal the category knowledge of a feature-point, which could cause bad localization. In this paper, we represent a region in an image by a collection of local feature-points and determine the object by the region with the maximum posterior probability of belonging to the object class. Based on the Bayes' theorem and Naive-Bayes assumptions, the posterior probability is reformulated as the sum of feature-scores. The feature-score is manifested in the form of the logarithm of a probability ratio. Instead of estimating the numerator and denominator probabilities separately, we readily employ the density ratio estimation techniques directly, and overcome the above limitation. Experiments on a car dataset and PASCAL VOC 2007 dataset validated the effectiveness of our method compared to the baselines. In addition, the performance can be further improved by taking advantage of the recently developed deep convolutional neural network features.

Interval Estimation for a Binomial Proportion Based on Weighted Polya Posterior (이항 비율의 가중 POLYA POSTERIOR 구간추정)

  • Lee Seung-Chun
    • The Korean Journal of Applied Statistics
    • /
    • v.18 no.3
    • /
    • pp.607-615
    • /
    • 2005
  • Recently the interval estimation of a binomial proportion is revisited in various literatures. This is mainly due to the erratic behavior of the coverage probability of the will-known Wald confidence interval. Various alternatives have been proposed. Among them, Agresti-Coull confidence interval has been recommended by Brown et al. (2001) with other confidence intervals for large sample, say n $\ge$ 40. On the other hand, a noninformative Bayesian approach called Polya posterior often produces statistics with good frequentist's properties. In this note, an interval estimator is developed using weighted Polya posterior. The resulting interval estimator is essentially the Agresti-Coull confidence interval with some improved features. It is shown that the weighted Polys posterior produce an effective interval estimator for small sample size and a severely skewed binomial distribution.

A Study on Modified Linear Prediction Method to Improve Target Estimation (목표물 추정 향상을 위한 수정 선형 예측방법에 대한 연구)

  • Lee, Kwan-Hyeong;Joo, Jong-Hyuk
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.9 no.4
    • /
    • pp.337-342
    • /
    • 2016
  • In this paper, we studied a modified linear prediction method to estimate target signal correctly. Linear prediction method estimate direction-of-arrival to linear combination for any antenna element and other antenna elements. Modified linear prediction used optimal weight and posterior probability method. Through simulation, we are comparative analysis about the performance of proposed, bartlett and MUSIC method. From simulation, Bartlett and MUSIC method was estimation 3 targets signal, and proposed method estimated 4 targets. We showed the superior performance of the proposed algorithm relative to the classical method in order to estimate of target signals.