• Title/Summary/Keyword: Monte Carlo Expectation Maximization

Search Result 21, Processing Time 0.028 seconds

Metropolis-Hastings Expectation Maximization Algorithm for Incomplete Data (불완전 자료에 대한 Metropolis-Hastings Expectation Maximization 알고리즘 연구)

  • Cheon, Soo-Young;Lee, Hee-Chan
    • The Korean Journal of Applied Statistics
    • /
    • v.25 no.1
    • /
    • pp.183-196
    • /
    • 2012
  • The inference for incomplete data such as missing data, truncated distribution and censored data is a phenomenon that occurs frequently in statistics. To solve this problem, Expectation Maximization(EM), Monte Carlo Expectation Maximization(MCEM) and Stochastic Expectation Maximization(SEM) algorithm have been used for a long time; however, they generally assume known distributions. In this paper, we propose the Metropolis-Hastings Expectation Maximization(MHEM) algorithm for unknown distributions. The performance of our proposed algorithm has been investigated on simulated and real dataset, KOSPI 200.

Super-spatial resolution method combined with the maximum-likelihood expectation maximization (MLEM) algorithm for alpha imaging detector

  • Kim, Guna;Lim, Ilhan;Song, Kanghyon;Kim, Jong-Guk
    • Nuclear Engineering and Technology
    • /
    • v.54 no.6
    • /
    • pp.2204-2212
    • /
    • 2022
  • Recently, the demand for alpha imaging detectors for quantifying the distributions of alpha particles has increased in various fields. This study aims to reconstruct a high-resolution image from an alpha imaging detector by applying a super-spatial resolution method combined with the maximum-likelihood expectation maximization (MLEM) algorithm. To perform the super-spatial resolution method, several images are acquired while slightly moving the detector to predefined positions. Then, a forward model for imaging is established by the system matrix containing the mechanical shifts, subsampling, and measured point-spread function of the imaging system. Using the measured images and system matrix, the MLEM algorithm is implemented, which converges towards a high-resolution image. We evaluated the performance of the proposed method through the Monte Carlo simulations and phantom experiments. The results showed that the super-spatial resolution method was successfully applied to the alpha imaging detector. The spatial resolution of the resultant image was improved by approximately 12% using four images. Overall, the study's outcomes demonstrate the feasibility of the super-spatial resolution method for the alpha imaging detector. Possible applications of the proposed method include high-resolution imaging for alpha particles of in vitro sliced tissue and pre-clinical biologic assessments for targeted alpha therapy.

Maximum-likelihood Estimation of Radar Cross Section of a Swerling III Target (Swerling III 표적 RCS의 최대공산추정)

  • Jung, Young-Hun;Hong, Sun-Mog
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.54 no.3
    • /
    • pp.87-93
    • /
    • 2017
  • A maximum likelihood (ML) approach is presented for estimating the mean of radar cross section (RCS) of a Swerling III target and its numerical solution methods are discussed. The solution methods are based on an approximate expression for implementing the expectation maximization (EM) algorithm. The methods are evaluated and compared through Monte Carlo simulations in terms of estimation accuracy and computational efficiency to obtain a most efficient method for both Swerling I and Swerling III targets. The methods are also compared with a previously reported method based on heuristics.

On the Bayesian Statistical Inference (베이지안 통계 추론)

  • Lee, Ho-Suk
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2007.06c
    • /
    • pp.263-266
    • /
    • 2007
  • This paper discusses the Bayesian statistical inference. This paper discusses the Bayesian inference, MCMC (Markov Chain Monte Carlo) integration, MCMC method, Metropolis-Hastings algorithm, Gibbs sampling, Maximum likelihood estimation, Expectation Maximization algorithm, missing data processing, and BMA (Bayesian Model Averaging). The Bayesian statistical inference is used to process a large amount of data in the areas of biology, medicine, bioengineering, science and engineering, and general data analysis and processing, and provides the important method to draw the optimal inference result. Lastly, this paper discusses the method of principal component analysis. The PCA method is also used for data analysis and inference.

  • PDF

Distributed Target Localization with Inaccurate Collaborative Sensors in Multipath Environments

  • Feng, Yuan;Yan, Qinsiwei;Tseng, Po-Hsuan;Hao, Ganlin;Wu, Nan
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.13 no.5
    • /
    • pp.2299-2318
    • /
    • 2019
  • Location-aware networks are of great importance for both civil lives and military applications. Methods based on line-of-sight (LOS) measurements suffer sever performance loss in harsh environments such as indoor scenarios, where sensors can receive both LOS and non-line-of-sight (NLOS) measurements. In this paper, we propose a data association (DA) process based on the expectation maximization (EM) algorithm, which enables us to exploit multipath components (MPCs). By setting the mapping relationship between the measurements and scatters as a latent variable, coefficients of the Gaussian mixture model are estimated. Moreover, considering the misalignment of sensor position, we propose a space-alternating generalized expectation maximization (SAGE)-based algorithms to jointly update the target localization and sensor position information. A two dimensional (2-D) circularly symmetric Gaussian distribution is employed to approximate the probability density function of the sensor's position uncertainty via the minimization of the Kullback-Leibler divergence (KLD), which enables us to calculate the expectation step with low computational complexity. Moreover, a distributed implementation is derived based on the average consensus method to improve the scalability of the proposed algorithm. Simulation results demonstrate that the proposed centralized and distributed algorithms can perform close to the Monte Carlo-based method with much lower communication overhead and computational complexity.

An estimation method for non-response model using Monte-Carlo expectation-maximization algorithm (Monte-Carlo expectation-maximaization 방법을 이용한 무응답 모형 추정방법)

  • Choi, Boseung;You, Hyeon Sang;Yoon, Yong Hwa
    • Journal of the Korean Data and Information Science Society
    • /
    • v.27 no.3
    • /
    • pp.587-598
    • /
    • 2016
  • In predicting an outcome of election using a variety of methods ahead of the election, non-response is one of the major issues. Therefore, to address the non-response issue, a variety of methods of non-response imputation may be employed, but the result of forecasting tend to vary according to methods. In this study, in order to improve electoral forecasts, we studied a model based method of non-response imputation attempting to apply the Monte Carlo Expectation Maximization (MCEM) algorithm, introduced by Wei and Tanner (1990). The MCEM algorithm using maximum likelihood estimates (MLEs) is applied to solve the boundary solution problem under the non-ignorable non-response mechanism. We performed the simulation studies to compare estimation performance among MCEM, maximum likelihood estimation, and Bayesian estimation method. The results of simulation studies showed that MCEM method can be a reasonable candidate for non-response model estimation. We also applied MCEM method to the Korean presidential election exit poll data of 2012 and investigated prediction performance using modified within precinct error (MWPE) criterion (Bautista et al., 2007).

Semiparametric Regression Splines in Matched Case-Control Studies

  • Kim, In-Young;Carroll, Raymond J.;Cohen, Noah
    • Proceedings of the Korean Statistical Society Conference
    • /
    • 2003.05a
    • /
    • pp.167-170
    • /
    • 2003
  • We develop semiparametric methods for matched case-control studies using regression splines. Three methods are developed: an approximate crossvalidation scheme to estimate the smoothing parameter inherent in regression splines, as well as Monte Carlo Expectation Maximization (MCEM) and Bayesian methods to fit the regression spline model. We compare the approximate cross-validation approach, MCEM and Bayesian approaches using simulation, showing that they appear approximately equally efficient, with the approximate cross-validation method being computationally the most convenient. An example from equine epidemiology that motivated the work is used to demonstrate our approaches.

  • PDF

Comparison of Three Parameter Estimation Methods for Mixture Distributions (혼합분포모형의 매개변수 추정방법 비교)

  • Shin, Ju-Young;Kim, Sooyoung;Kim, Taereem;Heo, Jun-Haeng
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2017.05a
    • /
    • pp.45-45
    • /
    • 2017
  • 상이한 자연현상으로 발생된 자료들은 때때로 통계적으로 다른 특성을 가지는 경우가 있다. 이런 자료들은 다른 두 개 이상의 모집단에서 자료가 발생한 것으로 가정할 수 가 있다. 기존에 널리 사용되어온 분포형 모형의 경우 단일한 모집단으로부터 자료가 발생한다는 가정하에서 개발된 모형들로 위에서 언급한 자료들을 적절히 모의할 수 없다. 이런 상이한 모집단에서 발생된 자료를 모형화 하기 위해서 혼합분포모형(mixture distribution)이 개발되었다. 홍수나 가뭄 등과 같은 극치 사상의 경우 다양한 자연현상들로부터 발생하기에 혼합분포모형을 적용할 경우 보다 정확한 모의가 가능하다. 혼합분포모형은 두 개 이상의 비혼합분포모형들을 가중합하여 만들어진다. 혼합 분포모형의 형태로 인하여 기존의 분포형 모형의 매개변수 추정 모형으로 널리 사용되던 최우도법 (maximum likelihood method), 모멘트법(method of moment), 확률가중모멘트법 (probability weighted moment method) 등을 이용하여 혼합분포모형의 매개변수를 추정하는 것이 용이 하지 않다. 혼합분포모형의 매개변수 추정 방법으로는 Expectation-Maximization (EM) 알고리즘, Meta-Heuristic Maximum Likelihood (MHML) 방법, Markov Chain Monte Carlo (MCMC) 방법 등이 적용되고 있다. 현재까지 수자원 분야에서 사용되는 극치 자료를 혼합분포모형을 이용하여 모의할 때 매개변수 추정방법에 따른 특성에 대한 연구가 진행되지 않았다. 본 연구에서는 우리나라 연최대강우량 자료를 이용하여 혼합분포모형의 매개변수 추정방법 (EM 알고리즘, MHML 방법, MCMC 방법) 들의 특성들을 비교 분석하였다. 혼합분포모형으로는 Gumbel-Gumbel 혼합분포 모형을 적용하였다. 본 연구의 결과는 향후 혼합분포모형을 이용한 연구에 좋은 기초자료로 사용될 수 있을 것으로 판단된다.

  • PDF

Study on the PET image quality according to various scintillation detectors based on the Monte Carlo simulation

  • Eunsoo Kim;Chanrok Park
    • The Korean Journal of Nuclear Medicine Technology
    • /
    • v.27 no.2
    • /
    • pp.129-132
    • /
    • 2023
  • Purpose: Positron emisson tomography (PET) is a crucial medical imaging scanner for the detection of cancer lesions. In order to maintain the improved image quality, it is crucial to apply detectors of superior performance. Therefore, the purpose of this study was to compare PET image quality using Monte Carlo simulation based on the detector materials of BGO, LSO, and LuAP. Materials and Methods: The Geant4 Application for Tomographic Emission (GATE) was used to design the PET detector. Scintillations with BGO, LSO and LuAP were modelled, with a size of 3.95 × 5.3 mm2 (width × height) and 25.0 mm (thickness). The PET detector consisted of 34 blocks per ring and a total of 4 rings. A line source of 1 MBq was modelled and acquired with a radius of 1 mm and length of 20 mm for 20 seconds. The acquired image was reconstructed maximum likelihood expectation maximization with 2 iteration and 10 subsets. The count comparison was carried out. Results and Discussion: The highest true, random, and scatter counts were obtained from the BGO scintillation detector compared to LSO and LuAP. Conclusion: The BGO scintillation detector material indicated excellent performance in terms of detection of gamma rays from emitted PET phantom.

ECM and GLR Based Multiuser Detection with I-CSI

  • Maio Antonio De;Episcopo Roberto;Lops Marco
    • Journal of Communications and Networks
    • /
    • v.7 no.1
    • /
    • pp.29-35
    • /
    • 2005
  • This paper deals with the problem of multiuser detection over a direct-sequence code-division multiple access (DS-CDMA) channel with incomplete channel state informations (I-CSI). We devise and assess two novel recursive detectors based on the expectation conditional maximization (ECM) algorithm and the generalized likelihood ratio (GLR) principle, respectively. Both receivers entail an affordable computational complexity. Moreover, the performance assessment, conducted via Monte Carlo techniques, shows that they achieve satisfactory performance levels and outperform linear detectors.