• Title/Summary/Keyword: Probability density estimation

Search Result 221, Processing Time 0.026 seconds

Verification and estimation of a posterior probability and probability density function using vector quantization and neural network (신경회로망과 벡터양자화에 의한 사후확률과 확률 밀도함수 추정 및 검증)

  • 고희석;김현덕;이광석
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.45 no.2
    • /
    • pp.325-328
    • /
    • 1996
  • In this paper, we proposed an estimation method of a posterior probability and PDF(Probability density function) using a feed forward neural network and code books of VQ(vector quantization). In this study, We estimates a posterior probability and probability density function, which compose a new parameter with well-known Mel cepstrum and verificate the performance for the five vowels taking from syllables by NN(neural network) and PNN(probabilistic neural network). In case of new parameter, showed the best result by probabilistic neural network and recognition rates are average 83.02%.

  • PDF

Monte Carlo Estimation of Multivariate Normal Probabilities

  • Oh, Man-Suk;Kim, Seung-Whan
    • Journal of the Korean Statistical Society
    • /
    • v.28 no.4
    • /
    • pp.443-455
    • /
    • 1999
  • A simulation-based approach to estimating the probability of an arbitrary region under a multivariate normal distribution is developed. In specific, the probability is expressed as the ratio of the unrestricted and the restricted multivariate normal density functions, where the restriction is given by the region whose probability is of interest. The density function of the restricted distribution is then estimated by using a sample generated from the Gibbs sampling algorithm.

  • PDF

Identification of the associations between genes and quantitative traits using entropy-based kernel density estimation

  • Yee, Jaeyong;Park, Taesung;Park, Mira
    • Genomics & Informatics
    • /
    • v.20 no.2
    • /
    • pp.17.1-17.11
    • /
    • 2022
  • Genetic associations have been quantified using a number of statistical measures. Entropy-based mutual information may be one of the more direct ways of estimating the association, in the sense that it does not depend on the parametrization. For this purpose, both the entropy and conditional entropy of the phenotype distribution should be obtained. Quantitative traits, however, do not usually allow an exact evaluation of entropy. The estimation of entropy needs a probability density function, which can be approximated by kernel density estimation. We have investigated the proper sequence of procedures for combining the kernel density estimation and entropy estimation with a probability density function in order to calculate mutual information. Genotypes and their interactions were constructed to set the conditions for conditional entropy. Extensive simulation data created using three types of generating functions were analyzed using two different kernels as well as two types of multifactor dimensionality reduction and another probability density approximation method called m-spacing. The statistical power in terms of correct detection rates was compared. Using kernels was found to be most useful when the trait distributions were more complex than simple normal or gamma distributions. A full-scale genomic dataset was explored to identify associations using the 2-h oral glucose tolerance test results and γ-glutamyl transpeptidase levels as phenotypes. Clearly distinguishable single-nucleotide polymorphisms (SNPs) and interacting SNP pairs associated with these phenotypes were found and listed with empirical p-values.

Non-parametric Density Estimation with Application to Face Tracking on Mobile Robot

  • Feng, Xiongfeng;Kubik, K.Bogunia
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.49.1-49
    • /
    • 2001
  • The skin color model is a very important concept in face detection, face recognition and face tracking. Usually, this model is obtained by estimating a probability density function of skin color distribution. In many cases, it is assumed that the underlying density function follows a Gaussian distribution. In this paper, a new method for non-parametric estimation of the probability density function, by using feed-forward neural network, is used to estimate the underlying skin color model. By using this method, the resulting skin color model is better than the Gaussian estimation and substantially approaches the real distribution. Applications to face detection and face ...

  • PDF

Stochastic Model based Fault Diagnosis System of Induction Motors using Online Probability Density Estimation (온라인 확률분포 추정기법을 이용한 확률모델 기반 유도전동기의 고장진단 시스템)

  • Cho, Hyun-Cheol;Kim, Kwang-Soo;Lee, Kwon-Soon
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.57 no.10
    • /
    • pp.1847-1853
    • /
    • 2008
  • This paper presents stochastic methodology based fault detection algorithm for induction motor systems. We measure current of healthy induction motors by means of hall sensor systems and then establish its probability distribution. We propose online probability density estimation which is effective in real-time implementation due to its simplicity and low computational burden. In addition, we accomplish theoretical analysis to demonstrate convergence property of the proposed estimation by using statistical convergence and system stability theory. We apply our fault diagnosis approach to three-phase induction motors and achieve real-time experiment for evaluating its reliability and practicability in industrial fields.

Estimation of Non-Gaussian Probability Density by Dynamic Bayesian Networks

  • Cho, Hyun-C.;Fadali, Sami M.;Lee, Kwon-S.
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.408-413
    • /
    • 2005
  • A new methodology for discrete non-Gaussian probability density estimation is investigated in this paper based on a dynamic Bayesian network (DBN) and kernel functions. The estimator consists of a DBN in which the transition distribution is represented with kernel functions. The estimator parameters are determined through a recursive learning algorithm according to the maximum likelihood (ML) scheme. A discrete-type Poisson distribution is generated in a simulation experiment to evaluate the proposed method. In addition, an unknown probability density generated by nonlinear transformation of a Poisson random variable is simulated. Computer simulations numerically demonstrate that the method successfully estimates the unknown probability distribution function (PDF).

  • PDF

Real-Time Motion Estimation Algorithm for Mobile Surveillance Robot (모바일 감시 로봇을 위한 실시간 움직임 추정 알고리즘)

  • Han, Cheol-Hoon;Sim, Kwee-Bo
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.19 no.3
    • /
    • pp.311-316
    • /
    • 2009
  • This paper presents the motion estimation algorithm on real-time for mobile surveillance robot using particle filter. the particle filter that based on the monte carlo's sampling method, use bayesian conditional probability model which having prior distribution probability and posterior distribution probability. However, the initial probability density was set to define randomly in the most of particle filter. In this paper, we find first the initial probability density using Sum of Absolute Difference(SAD). and we applied it in the partical filter. In result, more robust real-time estimation and tracking system on the randomly moving object was realized in the mobile surveillance robot environments.

Online Probability Density Estimation of Nonstationary Random Signal using Dynamic Bayesian Networks

  • Cho, Hyun-Cheol;Fadali, M. Sami;Lee, Kwon-Soon
    • International Journal of Control, Automation, and Systems
    • /
    • v.6 no.1
    • /
    • pp.109-118
    • /
    • 2008
  • We present two estimators for discrete non-Gaussian and nonstationary probability density estimation based on a dynamic Bayesian network (DBN). The first estimator is for off line computation and consists of a DBN whose transition distribution is represented in terms of kernel functions. The estimator parameters are the weights and shifts of the kernel functions. The parameters are determined through a recursive learning algorithm using maximum likelihood (ML) estimation. The second estimator is a DBN whose parameters form the transition probabilities. We use an asymptotically convergent, recursive, on-line algorithm to update the parameters using observation data. The DBN calculates the state probabilities using the estimated parameters. We provide examples that demonstrate the usefulness and simplicity of the two proposed estimators.

A Study on the Recursive Parameter Estimation Density Function Algorithm of the Probability (확률밀도합수의 축차모수추정방식에 관한 연구)

  • 한영렬;박진수
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.9 no.4
    • /
    • pp.163-169
    • /
    • 1984
  • We propose a new parameter estimation algorithm that converges with probability one and in mean square, if the mean is the function of parameter of the probability density function. This recursive algorithm is applicable also even though the parameters we estimate are multiparameter case. And the results are shown by the computer simulation.

  • PDF