• Title/Summary/Keyword: Method of Maximum Likelihood

Search Result 996, Processing Time 0.025 seconds

EMPIRICAL BAYES THRESHOLDING: ADAPTING TO SPARSITY WHEN IT ADVANTAGEOUS TO DO SO

  • Silverman Bernard W.
    • Journal of the Korean Statistical Society
    • /
    • v.36 no.1
    • /
    • pp.1-29
    • /
    • 2007
  • Suppose one is trying to estimate a high dimensional vector of parameters from a series of one observation per parameter. Often, it is possible to take advantage of sparsity in the parameters by thresholding the data in an appropriate way. A marginal maximum likelihood approach, within a suitable Bayesian structure, has excellent properties. For very sparse signals, the procedure chooses a large threshold and takes advantage of the sparsity, while for signals where there are many non-zero values, the method does not perform excessive smoothing. The scope of the method is reviewed and demonstrated, and various theoretical, practical and computational issues are discussed, in particularly exploring the wide potential and applicability of the general approach, and the way it can be used within more complex thresholding problems such as curve estimation using wavelets.

Comparison of Parameter Estimation Methods in A Kappa Distribution

  • Park Jeong-Soo;Hwang Young-A
    • Communications for Statistical Applications and Methods
    • /
    • v.12 no.2
    • /
    • pp.285-294
    • /
    • 2005
  • This paper deals with the comparison of parameter estimation methods in a 3-parameter Kappa distribution which is sometimes used in flood frequency analysis. Method of moment estimation(MME), L-moment estimation(L-ME), and maximum likelihood estimation(MLE) are applied to estimate three parameters. The performance of these methods are compared by Monte-carlo simulations. Especially for computing MME and L-ME, three dimensional nonlinear equations are simplified to one dimensional equation which is calculated by the Newton-Raphson iteration under constraint. Based on the criterion of the mean squared error, L-ME (or MME) is recommended to use for small sample size( n$\le$100) while MLE is good for large sample size.

Bayesian Estimation for Inflection S-shaped Software Reliability Growth Model (변곡 S-형 소프트웨어 신뢰도성장모형의 베이지안 모수추정)

  • Kim, Hee-Soo;Lee, Chong-Hyung;Park, Dong-Ho
    • Journal of Korean Society for Quality Management
    • /
    • v.37 no.4
    • /
    • pp.16-22
    • /
    • 2009
  • The inflection S-shaped software reliability growth model (SRGM) proposed by Ohba(1984) is one of the most commonly used models and has been discussed by many authors. The main purpose of this paper is to estimate the parameters of Ohba's SRGM within the Bayesian framework by applying the Markov chain Monte Carlo techniques. While the maximum likelihood estimates for these parameters are well known, the Bayesian method for the inflection S-shaped SRGM have not been discussed in the literature. The proposed methods can be quite flexible depending on the choice of prior distributions for the parameters of interests. We also compare the Bayesian methods with the maximum likelihood method numerically based on the real data.

Diagnostics for Estimated Smoothing Parameter by Generalized Maximum Likelihood Function (일반화최대우도함수에 의해 추정된 평활모수에 대한 진단)

  • Jung, Won-Tae;Lee, In-Suk;Jeong, Hae-Jeong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.7 no.2
    • /
    • pp.257-262
    • /
    • 1996
  • When we are estimate the smoothing parameter in spline regression model, we deal the diagnostic of influence observations as posteriori analysis. When we use Generalized Maximum Likelihood Function as the estimation method of smoothing parameter, we propose the diagnostic measure for influencial observations in the obtained estimate, and we introduce the finding method of the proper smoothing parameter estimate.

  • PDF

Bayesian Estimation of Three-parameter Bathtub Shaped Lifetime Distribution Based on Progressive Type-II Censoring with Binomial Removal

  • Chung, Younshik
    • Journal of the Korean Data Analysis Society
    • /
    • v.20 no.6
    • /
    • pp.2747-2757
    • /
    • 2018
  • We consider the MLE (maximum likelihood estimate) and Bayesian estimates of three-parameter bathtub-shaped lifetime distribution based on the progressive type II censoring with binomial removal. Jung, Chung (2018) proposed the three-parameter bathtub-shaped distribution which is the extension of the two-parameter bathtub-shaped distribution given by Zhang (2004). Jung, Chung (2018) investigated its properties and estimations. The maximum likelihood estimates are computed using Newton-Raphson algorithm. Also, Bayesian estimates are obtained under the balanced loss function using MCMC (Markov chain Monte Carlo) method. In particular, BSEL (balanced squared error loss) function is considered as a special form of balanced loss function given by Zellner (1994). For comparing theirs MLEs with the corresponding Bayes estimates, some simulations are performed. It shows that Bayes estimates is better than MLEs in terms of risks. Finally, concluding remarks are mentioned.

Parameter identification of the nonlinear stall motion from flight test data (비행시험을 통한 항공기의 비선형 실속 운동시의 매개변수 추정)

  • 전일환;황명신;이정훈
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1996.10b
    • /
    • pp.199-202
    • /
    • 1996
  • In this paper, we used the maximum likelihood method for 2-point aerodynamic model to determine the parameters of the ChangGong-91. Since the estimation from the flight test of real aircraft is the most reliable, we performed the flight test of ChangGong-91 to get the parameters such as velocity, height, 3 axis acceleration, 3 axis angular rate, pitch angle, angle of attack, temperature and so on. We recorded the flight test data in S-VHS tapes and stored them to personal computer using A/D(analog to digital) converter. Flight test was done in stall motion, and the acquired data was be processed with parameter identification method.

  • PDF

Inference Based on Generalized Doubly Type-II Hybrid Censored Sample from a Half Logistic Distribution

  • Lee, Kyeong-Jun;Park, Chan-Keun;Cho, Young-Seuk
    • Communications for Statistical Applications and Methods
    • /
    • v.18 no.5
    • /
    • pp.645-655
    • /
    • 2011
  • Chandrasekar et al. (2004) introduced a generalized Type-II hybrid censoring. In this paper, we propose generalized doubly Type-II hybrid censoring. In addition, this paper presents the statistical inference on the scale parameter for the half logistic distribution when samples are generalized doubly Type-II hybrid censoring. The approximate maximum likelihood(AMLE) method is developed to estimate the unknown parameter. The scale parameter is estimated by the AMLE method using two di erent Taylor series expansion types. We compar the AMLEs in the sense of the mean square error(MSE). The simulation procedure is repeated 10,000 times for the sample size n = 20; 30; 40 and various censored samples. The $AMLE_I$ is better than $AMLE_{II}$ in the sense of the MSE.

Semi-Continuous Hidden Markov Model with the MIN Module (MIN 모듈을 갖는 준연속 Hidden Markov Model)

  • Kim, Dae-Keuk;Lee, Jeong-Ju;Jeong, Ho-Kyoun;Lee, Sang-Hee
    • Speech Sciences
    • /
    • v.7 no.4
    • /
    • pp.11-26
    • /
    • 2000
  • In this paper, we propose the HMM with the MIN module. Because initial and re-estimated variance vectors are important elements for performance in HMM recognition systems, we propose a method which compensates for the mismatched statistical feature of training and test data. The MIN module function is a differentiable function similar to the sigmoid function. Unlike a continuous density function, it does not include variance vectors of the data set. The proposed hybrid HMM/MIN module is a unified network in which the observation probability in the HMM is replaced by the MIN module neural network. The parameters in the unified network are re-estimated by the gradient descent method for the Maximum Likelihood (ML) criterion. In estimating parameters, the variance vector is not estimated because there is no variance element in the MIN module function. The experiment was performed to compare the performance of the proposed HMM and the conventional HMM. The experiment measured an isolated number for speaker independent recognition.

  • PDF

Linear regression under log-concave and Gaussian scale mixture errors: comparative study

  • Kim, Sunyul;Seo, Byungtae
    • Communications for Statistical Applications and Methods
    • /
    • v.25 no.6
    • /
    • pp.633-645
    • /
    • 2018
  • Gaussian error distributions are a common choice in traditional regression models for the maximum likelihood (ML) method. However, this distributional assumption is often suspicious especially when the error distribution is skewed or has heavy tails. In both cases, the ML method under normality could break down or lose efficiency. In this paper, we consider the log-concave and Gaussian scale mixture distributions for error distributions. For the log-concave errors, we propose to use a smoothed maximum likelihood estimator for stable and faster computation. Based on this, we perform comparative simulation studies to see the performance of coefficient estimates under normal, Gaussian scale mixture, and log-concave errors. In addition, we also consider real data analysis using Stack loss plant data and Korean labor and income panel data.

High performance γ-ray imager using dual anti-mask method for the investigation of high-energy nuclear materials

  • Lee, Taewoong;Lee, Wonho
    • Nuclear Engineering and Technology
    • /
    • v.53 no.7
    • /
    • pp.2371-2376
    • /
    • 2021
  • As the γ-ray energy increases, a reconstructed image becomes noisy and blurred due to the penetration of the γ-ray through the coded mask. Therefore, the thickness of the coded mask was increased for high energy regions, resulting in severely decreased the performance of the detection efficiency due to self-collimation by the mask. In order to overcome the limitation, a modified uniformly redundant array γ-ray imaging system using dual anti-mask method was developed, and its performance was compared and evaluated in high-energy radiation region. In the dual anti-mask method, the two shadow images, including the subtraction of background events, can simultaneously contribute to the reconstructed image. Moreover, the reconstructed images using each shadow image were integrated using a hybrid update maximum likelihood expectation maximization (h-MLEM). Using the quantitative evaluation method, the performance of the dual anti-mask method was compared with the previously developed collimation methods. As the shadow image which was subtracted the background events leads to a higher-quality reconstructed image, the reconstructed image of the dual anti-mask method showed high performance among the three collimation methods. Finally, the quantitative evaluation method proves that the performance of the dual anti-mask method was better than that of the previously reconstruction methods.