• Title/Summary/Keyword: Maximum likelihood estimation (MLE)

Search Result 149, Processing Time 0.023 seconds

A data-adaptive maximum penalized likelihood estimation for the generalized extreme value distribution

  • Lee, Youngsaeng;Shin, Yonggwan;Park, Jeong-Soo
    • Communications for Statistical Applications and Methods
    • /
    • v.24 no.5
    • /
    • pp.493-505
    • /
    • 2017
  • Maximum likelihood estimation (MLE) of the generalized extreme value distribution (GEVD) is known to sometimes over-estimate the positive value of the shape parameter for the small sample size. The maximum penalized likelihood estimation (MPLE) with Beta penalty function was proposed by some researchers to overcome this problem. But the determination of the hyperparameters (HP) in Beta penalty function is still an issue. This paper presents some data adaptive methods to select the HP of Beta penalty function in the MPLE framework. The idea is to let the data tell us what HP to use. For given data, the optimal HP is obtained from the minimum distance between the MLE and MPLE. A bootstrap-based method is also proposed. These methods are compared with existing approaches. The performance evaluation experiments for GEVD by Monte Carlo simulation show that the proposed methods work well for bias and mean squared error. The methods are applied to Blackstone river data and Korean heavy rainfall data to show better performance over MLE, the method of L-moments estimator, and existing MPLEs.

Parameter Estimation for a Hilbert Space-valued Stochastic Differential Equation ?$\pm$

  • Kim, Yoon-Tae;Park, Hyun-Suk
    • Journal of the Korean Statistical Society
    • /
    • v.31 no.3
    • /
    • pp.329-342
    • /
    • 2002
  • We deal with asymptotic properties of Maximum Likelihood Estimator(MLE) for the parameters appearing in a Hilbert space-valued Stochastic Differential Equation(SDE) and a Stochastic Partial Differential Equation(SPDE). In paractice, the available data are only the finite dimensional projections to the solution of the equation. Using these data we obtain MLE and consider the asymptotic properties as the dimension of projections increases. In particular we explore a relationship between the conditions for the solution and asymptotic properties of MLE.

Hybrid Speaker Adaptation using Maximum-Likelihood Estimation (MLE를 이용한 하이브리드 화자 적응)

  • 표현아;김세현;오영환
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2002.10d
    • /
    • pp.268-270
    • /
    • 2002
  • 최근 음성 인식 시스템의 성능 향상을 위해 화자 적응 (speaker adaptation)에 대한 연구가 활발히 진행되고 있다. HMM 기반 인식 시스템의 모델 파라미터를 수정하는 화자 적응의 경우, MAP방법과 MLLR 방법에 대한 연구가 주류를 이루고 있다. 두 방법은 adaptation data의 양에 따라서 서로 다른 성능을 보인다. 본 논문에서는 기존 두 방법을 Maximum-likelihood Estimation(MLE)를 이용하여 화자 적응을 수행하는 방법을 제안한다. 제안한 방법을 KAIST 통신연구실에서 구축한 한국어 도시이름 500단어 인식 시스템에 적용하여 adaptation data의 양에 상관없이 항상 높은 성능을 나타냈으며, 기존의 방법에 대해서 최고 4.37%의 인식률 향상을 보였다.

  • PDF

Performance Comparison of Radar Signal Active Cancellation Systems According to Pulsed-CW Parameter Estimation Error (Pulsed-CW 신호 파라미터 추정 오차에 따른 레이더 신호 능동 상쇄 성능 비교)

  • Choi, Seung-Kyu;Lee, Chung-Yong
    • Journal of the Institute of Electronics Engineers of Korea TC
    • /
    • v.48 no.10
    • /
    • pp.60-66
    • /
    • 2011
  • In this paper, we analyze the effects of estimation error in the active cancellation signal, which is intended to counter the pulsed-CW signal of a hostile radar. We also examine the effects of estimation error in maximum-likelihood estimation (MLE) and quadratic interpolation scheme from a radar signal active cancellation viewpoint. Then, we modify the correlation-based error compensation scheme which mitigates the estimation error of MLE to improve the performance of the active cancellation signal. Finally, we present simulation results to show that the correlation-based scheme has better performance than the other in terms of radar signal active cancellation.

Estimation in the exponential distribution under progressive Type I interval censoring with semi-missing data

  • Shin, Hyejung;Lee, Kwangho
    • Journal of the Korean Data and Information Science Society
    • /
    • v.23 no.6
    • /
    • pp.1271-1277
    • /
    • 2012
  • In this paper, we propose an estimation method of the parameter in an exponential distribution based on a progressive Type I interval censored sample with semi-missing observation. The maximum likelihood estimator (MLE) of the parameter in the exponential distribution cannot be obtained explicitly because the intervals are not equal in length under the progressive Type I interval censored sample with semi-missing data. To obtain the MLE of the parameter for the sampling scheme, we propose a method by which progressive Type I interval censored sample with semi-missing data is converted to the progressive Type II interval censored sample. Consequently, the estimation procedures in the progressive Type II interval censored sample can be applied and we obtain the MLE of the parameter and survival function. It will be shown that the obtained estimators have good performance in terms of the mean square error (MSE) and mean integrated square error (MISE).

Comparison of Parameter Estimation Methods in A Kappa Distribution

  • Park Jeong-Soo;Hwang Young-A
    • Communications for Statistical Applications and Methods
    • /
    • v.12 no.2
    • /
    • pp.285-294
    • /
    • 2005
  • This paper deals with the comparison of parameter estimation methods in a 3-parameter Kappa distribution which is sometimes used in flood frequency analysis. Method of moment estimation(MME), L-moment estimation(L-ME), and maximum likelihood estimation(MLE) are applied to estimate three parameters. The performance of these methods are compared by Monte-carlo simulations. Especially for computing MME and L-ME, three dimensional nonlinear equations are simplified to one dimensional equation which is calculated by the Newton-Raphson iteration under constraint. Based on the criterion of the mean squared error, L-ME (or MME) is recommended to use for small sample size( n$\le$100) while MLE is good for large sample size.

Wakeby Distribution and the Maximum Likelihood Estimation Algorithm in Which Probability Density Function Is Not Explicitly Expressed

  • Park Jeong-Soo
    • Communications for Statistical Applications and Methods
    • /
    • v.12 no.2
    • /
    • pp.443-451
    • /
    • 2005
  • The studied in this paper is a new algorithm for searching the maximum likelihood estimate(MLE) in which probability density function is not explicitly expressed. Newton-Raphson's root-finding routine and a nonlinear numerical optimization algorithm with constraint (so-called feasible sequential quadratic programming) are used. This algorithm is applied to the Wakeby distribution which is importantly used in hydrology and water resource research for analysis of extreme rainfall. The performance comparison between maximum likelihood estimates and method of L-moment estimates (L-ME) is studied by Monte-carlo simulation. The recommended methods are L-ME for up to 300 observations and MLE for over the sample size, respectively. Methods for speeding up the algorithm and for computing variances of estimates are discussed.

Parameter Estimation for an Infinite Dimensional Stochastic Differential Equation

  • Kim, Yoon-Tae
    • Journal of the Korean Statistical Society
    • /
    • v.25 no.2
    • /
    • pp.161-173
    • /
    • 1996
  • When we deal with a Hilbert space-valued Stochastic Differential Equation (SDE) (or Stochastic Partial Differential Equation (SPDE)), depending on some unknown parameters, the solution usually has a Fourier series expansion. In this situation we consider the maximum likelihood method for the statistical estimation problem and derive the asymptotic properties (consistency and normality) of the Maximum Likelihood Estimator (MLE).

  • PDF

Estimation for ordered means in normal distributions

  • Cho, Kil-Ho
    • Journal of the Korean Data and Information Science Society
    • /
    • v.21 no.5
    • /
    • pp.951-958
    • /
    • 2010
  • In this paper, we obtain the restricted maximum likelihood estimators (RMLE's) for means in normal distributions with the ordered mean constraints. The biases and mean squared errors (MSE's) of these RMLE's are approximated by Mote Carlo methods. In every case a substantial savings in MSE is obtained at the expense of a small loss in bias when using RMLE's instead of the unrestricted MLE's.

BERRY-ESSEEN BOUND FOR MLE FOR LINEAR STOCHASTIC DIFFERENTIAL EQUATIONS DRIVEN BY FRACTIONAL BROWNIAN MOTION

  • RAO B.L.S. PRAKASA
    • Journal of the Korean Statistical Society
    • /
    • v.34 no.4
    • /
    • pp.281-295
    • /
    • 2005
  • We investigate the rate of convergence of the distribution of the maximum likelihood estimator (MLE) of an unknown parameter in the drift coefficient of a stochastic process described by a linear stochastic differential equation driven by a fractional Brownian motion (fBm). As a special case, we obtain the rate of convergence for the case of the fractional Ornstein- Uhlenbeck type process studied recently by Kleptsyna and Le Breton (2002).