• Title/Summary/Keyword: Normal likelihood estimation

Search Result 82, Processing Time 0.023 seconds

Comparison of parameter estimation methods for normal inverse Gaussian distribution

  • Yoon, Jeongyoen;Kim, Jiyeon;Song, Seongjoo
    • Communications for Statistical Applications and Methods
    • /
    • v.27 no.1
    • /
    • pp.97-108
    • /
    • 2020
  • This paper compares several methods for estimating parameters of normal inverse Gaussian distribution. Ordinary maximum likelihood estimation and the method of moment estimation often do not work properly due to restrictions on parameters. We examine the performance of adjusted estimation methods along with the ordinary maximum likelihood estimation and the method of moment estimation by simulation and real data application. We also see the effect of the initial value in estimation methods. The simulation results show that the ordinary maximum likelihood estimator is significantly affected by the initial value; in addition, the adjusted estimators have smaller root mean square error than ordinary estimators as well as less impact on the initial value. With real datasets, we obtain similar results to what we see in simulation studies. Based on the results of simulation and real data application, we suggest using adjusted maximum likelihood estimates with adjusted method of moment estimates as initial values to estimate the parameters of normal inverse Gaussian distribution.

On the maximum likelihood estimation for a normal distribution under random censoring

  • Kim, Namhyun
    • Communications for Statistical Applications and Methods
    • /
    • v.25 no.6
    • /
    • pp.647-658
    • /
    • 2018
  • In this paper, we study statistical inferences on the maximum likelihood estimation of a normal distribution when data are randomly censored. Likelihood equations are derived assuming that the censoring distribution does not involve any parameters of interest. The maximum likelihood estimators (MLEs) of the censored normal distribution do not have an explicit form, and it should be solved in an iterative way. We consider a simple method to derive an explicit form of the approximate MLEs with no iterations by expanding the nonlinear parts of the likelihood equations in Taylor series around some suitable points. The points are closely related to Kaplan-Meier estimators. By using the same method, the observed Fisher information is also approximated to obtain asymptotic variances of the estimators. An illustrative example is presented, and a simulation study is conducted to compare the performances of the estimators. In addition to their explicit form, the approximate MLEs are as efficient as the MLEs in terms of variances.

An Approximation of the Cumulant Generating Functions of Diffusion Models and the Pseudo-likelihood Estimation Method (확산모형에 대한 누율생성함수의 근사와 가우도 추정법)

  • Lee, Yoon-Dong;Lee, Eun-Kyung
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.38 no.1
    • /
    • pp.201-216
    • /
    • 2013
  • Diffusion is a basic mathematical tool for modern financial engineering. The theory of the estimation methods for diffusion models is an important topic of the financial engineering. Many researches have been tried to apply the likelihood estimation method for estimating diffusion models. However, the likelihood estimation method for diffusion is complicated and needs much amount of computing. In this paper we develop the estimation methods which are simple enough to be compared to the Euler approximation method, and efficient enough statistically to be compared to the likelihood estimation method. We devise pseudo-likelihood and propose the maximum pseudo-likelihood estimation methods. The pseudo-likelihoods are obtained by approximating the transition density with normal distributions. The means and the variances of the distributions are obtained from the delta expansion suggested by Lee, Song and Lee (2012). We compare the newly suggested estimators with other existing estimators by simulation study. From the simulation study we find the maximum pseudo-likelihood estimator has very similar properties with the maximum likelihood estimator. Also the maximum pseudo-likelihood estimator is easy to apply to general diffusion models, and can be obtained by simple numerical steps.

On the Estimation in Regression Models with Multiplicative Errors

  • Park, Cheol-Yong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.10 no.1
    • /
    • pp.193-198
    • /
    • 1999
  • The estimation of parameters in regression models with multiplicative errors is usually based on the gamma or log-normal likelihoods. Under reciprocal misspecification, we compare the small sample efficiencies of two sets of estimators via a Monte Carlo study. We further consider the case where the errors are a random sample from a Weibull distribution. We compute the asymptotic relative efficiency of quasi-likelihood estimators on the original scale to least squares estimators on the log-transformed scale and perform a Monte Carlo study to compare the small sample performances of quasi-likelihood and least squares estimators.

  • PDF

On Computing a Cholesky Decomposition

  • Park, Jong-Tae
    • Communications for Statistical Applications and Methods
    • /
    • v.3 no.2
    • /
    • pp.37-42
    • /
    • 1996
  • Maximum likelihood estimation of Cholesky decomposition is considered under normality assumption. It is shown that maximum liklihood estimation gives a Cholesky decomposition of the sample covariance matrix. The joint distribution of the maximum likelihood estimators is derived. The ussual algorithm for a Cholesky decomposition is shown to be equivalent to a maximumlikelihood estimation of a Cholesky root when the underlying distribution is a multivariate normal one.

  • PDF

Likelihood Ratio Criterion for Testing Sphericity from a Multivariate Normal Sample with 2-step Monotone Missing Data Pattern

  • Choi, Byung-Jin
    • Communications for Statistical Applications and Methods
    • /
    • v.12 no.2
    • /
    • pp.473-481
    • /
    • 2005
  • The testing problem for sphericity structure of the covariance matrix in a multivariate normal distribution is introduced when there is a sample with 2-step monotone missing data pattern. The maximum likelihood method is described to estimate the parameters on the basis of the sample. Using these estimates, the likelihood ratio criterion for testing sphericity is derived.

On Practical Efficiency of Locally Parametric Nonparametric Density Estimation Based on Local Likelihood Function

  • Kang, Kee-Hoon;Han, Jung-Hoon
    • Communications for Statistical Applications and Methods
    • /
    • v.10 no.2
    • /
    • pp.607-617
    • /
    • 2003
  • This paper offers a practical comparison of efficiency between local likelihood approach and conventional kernel approach in density estimation. The local likelihood estimation procedure maximizes a kernel smoothed log-likelihood function with respect to a polynomial approximation of the log likelihood function. We use two types of data driven bandwidths for each method and compare the mean integrated squares for several densities. Numerical results reveal that local log-linear approach with simple plug-in bandwidth shows better performance comparing to the standard kernel approach in heavy tailed distribution. For normal mixture density cases, standard kernel estimator with the bandwidth in Sheather and Jones(1991) dominates the others in moderately large sample size.

A Study of Estimation Method for Auto-Regressive Model with Non-Normal Error and Its Prediction Accuracy (비정규 오차를 고려한 자기회귀모형의 추정법 및 예측성능에 관한 연구)

  • Lim, Bo Mi;Park, Cheong-Sool;Kim, Jun Seok;Kim, Sung-Shick;Baek, Jun-Geol
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.39 no.2
    • /
    • pp.109-118
    • /
    • 2013
  • We propose a method for estimating coefficients of AR (autoregressive) model which named MLPAR (Maximum Likelihood of Pearson system for Auto-Regressive model). In the present method for estimating coefficients of AR model, there is an assumption that residual or error term of the model follows the normal distribution. In common cases, we can observe that the error of AR model does not follow the normal distribution. So the normal assumption will cause decreasing prediction accuracy of AR model. In the paper, we propose the MLPAR which does not assume the normal distribution of error term. The MLPAR estimates coefficients of auto-regressive model and distribution moments of residual by using pearson distribution system and maximum likelihood estimation. Comparing proposed method to auto-regressive model, results are shown to verify improved performance of the MLPAR in terms of prediction accuracy.

Parameter Estimation From Singly Censored Normal Sample (관측중단된 정규표본으로부터의 모수추정에 관한 연구)

  • Gwon, Yeong-Il
    • Journal of Korean Society for Quality Management
    • /
    • v.15 no.2
    • /
    • pp.61-68
    • /
    • 1987
  • This paper considers the estimation of the parameters of a normal population from which a sample which has been censored at a known point is obtained. Simple estimators are presented which are given in closed forms. It is shown that maximum likelihood estimators are obtained by using the estimation procedure iteratively. Some computer simulation results are given.

  • PDF