• Journal of the Korean Data and Information Science Society
• /
• 제17권3호
• /
• pp.919-925
• /
• 2006

Maximum likelihood estimate(MLE) is obtained from the partial log-likelihood function for the cell probabilities of two way incomplete contingency tables proposed by Chen and Fienberg(1974). The partial log-likelihood function is modified by adding lagrangian multiplier that constraints can be incorporated with. Variances of MLE estimators of population proportions are derived from the matrix of second derivatives of the loglikelihood with respect to cell probabilities. Simulation results, when data are missing at random, reveal that Complete-case(CC) analysis produces biased estimates of joint probabilities under MAR and less efficient than either MLE or MI. MLE and MI provides consistent results under either the MAR situation. MLE provides more efficient estimates of population proportions than either multiple imputation(MI) based on data augmentation or complete case analysis. The standard errors of MLE from the proposed method using lagrangian multiplier are valid and have less variation than the standard errors from MI and CC.

• 산업경영시스템학회지
• /
• 제28권3호
• /
• pp.26-35
• /
• 2005

This paper is intended to compare the hazard rate estimations from Bayesian approach and maximum likelihood estimate(MLE) method. Hazard rate frequently involves unknown parameters and it is common that those parameters are estimated from observed data by using MLE method. Such estimated parameters are appropriate as long as there are sufficient data. Due to various reasons, however, we frequently cannot obtain sufficient data so that the result of MLE method may be unreliable. In order to resolve such a problem we need to rely on the judgement about the unknown parameters. We do this by adopting the Bayesian approach. The first one is to use a predictive distribution and the second one is a method called Bayesian estimate. In addition, in the Bayesian approach, the prior distribution has a critical effect on the result of analysis, so we introduce the method using computerized-simulation to elicit an effective prior distribution. For the simplicity, we use exponential and gamma distributions as a likelihood distribution and its natural conjugate prior distribution, respectively. Finally, numerical examples are given to illustrate the potential benefits of the Bayesian approach.

• 대한산업공학회지
• /
• 제42권4호
• /
• pp.256-262
• /
• 2016

The Weibull is widely used in reliability analysis, and several studies have attempted to improve estimation of the distribution's parameters. least squares estimation (LSE) or Maximum likelihood estimation (MLE) are often used to estimate distribution parameters. However, it has been proven that Bayesian methods are more suitable for small sample sizes than LSE and MLE. In this work, the Weibull parameter estimation accuracy of LSE, MLE, and Bayesian method are compared for sample sets with 3 to 30 data points. The Bayesian method was most accurate for sample sizes under 25, and the accuracy of the Bayesian method was similar to LSE and MLE as the sample size increased.

• Communications for Statistical Applications and Methods
• /
• 제12권2호
• /
• pp.443-451
• /
• 2005

The studied in this paper is a new algorithm for searching the maximum likelihood estimate(MLE) in which probability density function is not explicitly expressed. Newton-Raphson's root-finding routine and a nonlinear numerical optimization algorithm with constraint (so-called feasible sequential quadratic programming) are used. This algorithm is applied to the Wakeby distribution which is importantly used in hydrology and water resource research for analysis of extreme rainfall. The performance comparison between maximum likelihood estimates and method of L-moment estimates (L-ME) is studied by Monte-carlo simulation. The recommended methods are L-ME for up to 300 observations and MLE for over the sample size, respectively. Methods for speeding up the algorithm and for computing variances of estimates are discussed.

• Communications for Statistical Applications and Methods
• /
• 제24권5호
• /
• pp.493-505
• /
• 2017

Maximum likelihood estimation (MLE) of the generalized extreme value distribution (GEVD) is known to sometimes over-estimate the positive value of the shape parameter for the small sample size. The maximum penalized likelihood estimation (MPLE) with Beta penalty function was proposed by some researchers to overcome this problem. But the determination of the hyperparameters (HP) in Beta penalty function is still an issue. This paper presents some data adaptive methods to select the HP of Beta penalty function in the MPLE framework. The idea is to let the data tell us what HP to use. For given data, the optimal HP is obtained from the minimum distance between the MLE and MPLE. A bootstrap-based method is also proposed. These methods are compared with existing approaches. The performance evaluation experiments for GEVD by Monte Carlo simulation show that the proposed methods work well for bias and mean squared error. The methods are applied to Blackstone river data and Korean heavy rainfall data to show better performance over MLE, the method of L-moments estimator, and existing MPLEs.

• 대한산업공학회지
• /
• 제33권1호
• /
• pp.52-60
• /
• 2007

Estimating parameters of the lifetime distribution is investigated when field failure data are not completelyreported. To take into account the reality and the accuracy of the estimates in such a case, the failure reportingprobability is incorporated in estimating parameters, Firstly, method of maximum likelihood estimate (MLE) isused to estimate parameters of the lifetime distribution when failure reporting probability is known, Secondly,Expectation and Maximization (EM) algorithm is used to estimate the failure reporting probability and parame-ters of the lifetime distribution simultaneously when failure reporting probability is unknown. For both cases,procedures of estimation are illustrated for single Weibull distribution and mixed Weibull distribution. Simula-tion results show that MLE obtained by the proposed method is more accurate than the conventional MLE.

• 한국경영과학회:학술대회논문집
• /
• 한국경영과학회/대한산업공학회 2005년도 춘계공동학술대회 발표논문
• /
• pp.678-685
• /
• 2005

Estimating parameters of the lifetime distribution is investigated when field failure data are not completely reported. To take into account the reality and the accuracy of the estimates in such a case, the failure reporting probability is incorporated in estimating parameters. Firstly, method of maximum likelihood estimate(MLE) is used to estimate parameters of the lifetime distribution when failure reporting probability is known. Secondly, Expectation and Maximization(EM) algorithm is used to estimate the failure reporting probability and parameters of the lifetime distribution simultaneously when failure reporting probability is unknown. For both case, procedures of estimation are illustrated for single Weibull distribution and mixed Weibull distribution. Simulation results show that MLE obtained by the proposed method is more accurate than the conventional MLE.

• Communications for Statistical Applications and Methods
• /
• 제12권2호
• /
• pp.285-294
• /
• 2005

This paper deals with the comparison of parameter estimation methods in a 3-parameter Kappa distribution which is sometimes used in flood frequency analysis. Method of moment estimation(MME), L-moment estimation(L-ME), and maximum likelihood estimation(MLE) are applied to estimate three parameters. The performance of these methods are compared by Monte-carlo simulations. Especially for computing MME and L-ME, three dimensional nonlinear equations are simplified to one dimensional equation which is calculated by the Newton-Raphson iteration under constraint. Based on the criterion of the mean squared error, L-ME (or MME) is recommended to use for small sample size( n$\le$100) while MLE is good for large sample size.

• 한국품질경영학회:학술대회논문집
• /
• 한국품질경영학회 2004년도 품질경영모델을 통한 가치 창출
• /
• pp.436-441
• /
• 2004

Knowing the time of the process change could lead to quicker identification of the responsible special cause and less process down time, and it could help to reduce the probability of incorrectly identifying the special cause. In this paper, we propose a generalized maximum likelihood estimate. (MLE) of the process change point when a control chart with variable sample size (VSS) scheme signals a change in the process mean, and evaluate the performance of this estimator when it mi used with a VSS EWMA chart.

• Journal of the Korean Statistical Society
• /
• 제2권1호
• /
• pp.9-15
• /
• 1973

In the first-order moving average model, we present the exact likelihood equations as function of variance, correlation and parameters of coefficients in the orthogonally transformed model. Existence of maximum likelihood estimates for these unknowns are studied and a computational method is provided. (Because of the limited space Ive do not present the computer program which is written in FORTRAN.) 40 sets of generated data and economic data are used to demonstrate, and few of them are presented in the Appendix. A numerical comparison of MLE with the efficient estimate proposed by Durbin is presented in the particular case.