• Title/Summary/Keyword: Maximum likelihood estimation (MLE)

Search Result 149, Processing Time 0.03 seconds

Regularity of Maximum Likelihood Estimation for ARCH Regression Model with Lagged Dependent Variables

  • Hwang, Sun Y.
    • Journal of the Korean Statistical Society
    • /
    • v.29 no.1
    • /
    • pp.9-16
    • /
    • 2000
  • This article addresses the problem of maximum likelihood estimation in ARCH regression with lagged dependent variables. Some topics in asymptotics of the model such as uniform expansion of likelihood function and construction of a class of MLE are discussed, and the regularity property of MLE is obtained. The error process here is possibly non-Gaussian.

  • PDF

Bayesian and maximum likelihood estimation of entropy of the inverse Weibull distribution under generalized type I progressive hybrid censoring

  • Lee, Kyeongjun
    • Communications for Statistical Applications and Methods
    • /
    • v.27 no.4
    • /
    • pp.469-486
    • /
    • 2020
  • Entropy is an important term in statistical mechanics that was originally defined in the second law of thermodynamics. In this paper, we consider the maximum likelihood estimation (MLE), maximum product spacings estimation (MPSE) and Bayesian estimation of the entropy of an inverse Weibull distribution (InW) under a generalized type I progressive hybrid censoring scheme (GePH). The MLE and MPSE of the entropy cannot be obtained in closed form; therefore, we propose using the Newton-Raphson algorithm to solve it. Further, the Bayesian estimators for the entropy of InW based on squared error loss function (SqL), precautionary loss function (PrL), general entropy loss function (GeL) and linex loss function (LiL) are derived. In addition, we derive the Lindley's approximate method (LiA) of the Bayesian estimates. Monte Carlo simulations are conducted to compare the results among MLE, MPSE, and Bayesian estimators. A real data set based on the GePH is also analyzed for illustrative purposes.

Multi-Pulse Amplitude and Location Estimation by Maximum-Likelihood Estimation in MPE-LPC Speech Synthesis (MPE-LPC음성합성에서 Maximum- Likelihood Estimation에 의한 Multi-Pulse의 크기와 위치 추정)

  • 이기용;최홍섭;안수길
    • Journal of the Korean Institute of Telematics and Electronics
    • /
    • v.26 no.9
    • /
    • pp.1436-1443
    • /
    • 1989
  • In this paper, we propose a maximum-likelihood estimation(MLE) method to obtain the location and the amplitude of the pulses in MPE( multi-pulse excitation)-LPC speech synthesis using multi-pulses as excitation source. This MLE method computes the value maximizing the likelihood function with respect to unknown parameters(amplitude and position of the pulses) for the observed data sequence. Thus in the case of overlapped pulses, the method is equivalent to Ozawa's crosscorrelation method, resulting in equal amount of computation and sound quality with the cross-correlation method. We show by computer simulation: the multi-pulses obtained by MLE method are(1) pseudo-periodic in pitch in the case of voicde sound, (2) the pulses are random for unvoiced sound, (3) the pulses change from random to periodic in the interval where the original speech signal changes from unvoiced to voiced. Short time power specta of original speech and syunthesized speech obtained by using multi-pulses as excitation source are quite similar to each other at the formants.

  • PDF

Communication performance of selective combining frequency diversity with maximum likelihood estimation in underwater multipath frequency selective channels (수중 다중경로 주파수 선택적 채널에서 최대우도추정을 적용한 선택적합성 주파수 다이버시티의 통신 성능)

  • Lee, Chaehui;Park, Kyu-Chil;Park, Jihyun
    • The Journal of the Acoustical Society of Korea
    • /
    • v.41 no.2
    • /
    • pp.143-149
    • /
    • 2022
  • In this paper, we evaluate the underwater frequency diversity communication performance of Selective Combination (SC) using Maximum Likelihood Estimation (MLE). In an underwater multipath frequency selective channel, destructive interference fading due to delay spread of a received signal affects the increase in error and Signal to Noise Ratio (SNR) variability of an underwater acoustic communication. Selective Combination frequency diversity using a single sensor is applied as a transmission performance improvement technique according to the frequency selectivity of a channel. In the sea experiment applying MLE for SC decision value extraction, we evaluate the performance of SC frequency diversity and MLE-SC frequency diversity. In experiment result, we confirm through experiment that the Bit Error Rate (BER) is relatively lower when the decision value extracted through MLE-SC is applied than when the SC decision value is fixed.

MCE Training Algorithm for a Speech Recognizer Detecting Mispronunciation of a Foreign Language (외국어 발음오류 검출 음성인식기를 위한 MCE 학습 알고리즘)

  • Bae, Min-Young;Chung, Yong-Joo;Kwon, Chul-Hong
    • Speech Sciences
    • /
    • v.11 no.4
    • /
    • pp.43-52
    • /
    • 2004
  • Model parameters in HMM based speech recognition systems are normally estimated using Maximum Likelihood Estimation(MLE). The MLE method is based mainly on the principle of statistical data fitting in terms of increasing the HMM likelihood. The optimality of this training criterion is conditioned on the availability of infinite amount of training data and the correct choice of model. However, in practice, neither of these conditions is satisfied. In this paper, we propose a training algorithm, MCE(Minimum Classification Error), to improve the performance of a speech recognizer detecting mispronunciation of a foreign language. During the conventional MLE(Maximum Likelihood Estimation) training, the model parameters are adjusted to increase the likelihood of the word strings corresponding to the training utterances without taking account of the probability of other possible word strings. In contrast to MLE, the MCE training scheme takes account of possible competing word hypotheses and tries to reduce the probability of incorrect hypotheses. The discriminant training method using MCE shows better recognition results than the MLE method does.

  • PDF

Preformance Comparison of MLE Technique with POF(Pencil of Functions) Method for SEM Parameter Estimation (SEM 파라메타 측정에 대한 MLE 기법과 POF 기법의 성능비교)

  • Kim, Deok-Nyeon
    • The Transactions of the Korea Information Processing Society
    • /
    • v.1 no.4
    • /
    • pp.511-516
    • /
    • 1994
  • Parameter estimation techniques are discussed for the complex frequency analysis of an electromagnetic scatterer. The paper suggests how the Maximum Likelihood estimation technique can be applied for this purpose. Experiments on hypothetical data sets demonstrate that the Maximum Likelihood technique is better than the Pencil of Functions technique. Although there have been several techniques including MLE suggested as tools of the parameter estimation, the proposed method has strong advantages under the noise-contaminated sample data environment because it uses minimal dimension of system matrix that stands totally independent of the length of extracted data set.

  • PDF

Estimation for the Half Logistic Distribution Based on Double Hybrid Censored Samples

  • Kang, Suk-Bok;Cho, Young-Seuk;Han, Jun-Tae
    • Communications for Statistical Applications and Methods
    • /
    • v.16 no.6
    • /
    • pp.1055-1066
    • /
    • 2009
  • Many articles have considered a hybrid censoring scheme, which is a mixture of Type-I and Type-II censoring schemes. We introduce a double hybrid censoring scheme and derive some approximate maximum likelihood estimators(AMLEs) of the scale parameter for the half logistic distribution under the proposed double hybrid censored samples. The scale parameter is estimated by approximate maximum likelihood estimation method using two different Taylor series expansion types. We also obtain the maximum likelihood estimator(MLE) and the least square estimator(LSE) of the scale parameter under the proposed double hybrid censored samples. We compare the proposed estimators in the sense of the mean squared error. The simulation procedure is repeated 10,000 times for the sample size n = 20(10)40 and various censored samples. The performances of the AMLEs and MLE are very similar in all aspects but the MLE and LSE have not a closed-form expression, some numerical method must be employed.

A Comparison of the Reliability Estimation Accuracy between Bayesian Methods and Classical Methods Based on Weibull Distribution (와이블분포 하에서 베이지안 기법과 전통적 기법 간의 신뢰도 추정 정확도 비교)

  • Cho, HyungJun;Lim, JunHyoung;Kim, YongSoo
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.42 no.4
    • /
    • pp.256-262
    • /
    • 2016
  • The Weibull is widely used in reliability analysis, and several studies have attempted to improve estimation of the distribution's parameters. least squares estimation (LSE) or Maximum likelihood estimation (MLE) are often used to estimate distribution parameters. However, it has been proven that Bayesian methods are more suitable for small sample sizes than LSE and MLE. In this work, the Weibull parameter estimation accuracy of LSE, MLE, and Bayesian method are compared for sample sets with 3 to 30 data points. The Bayesian method was most accurate for sample sizes under 25, and the accuracy of the Bayesian method was similar to LSE and MLE as the sample size increased.

Estimation of nonlinear censored simultaneous equations models : An Application of Quasi Maximum Likelihood Methods (절삭된 연립방정식 모형의 추정에 대한 몬테칼로 비교)

  • 이회경
    • The Korean Journal of Applied Statistics
    • /
    • v.4 no.1
    • /
    • pp.13-24
    • /
    • 1991
  • This paper presents a Monte Carlo evaluation of estimators for nonlinear consored simultaneous equations models. We examine the performance of the maximum likelihood estimator (MLE), the two-step quasi maximum likelihood estimator (2QMLE) proposed by Lee and Hurd (1989), and another quasi MLe using least squares at the first step (LSAE) under varying degrees of freedom and underlying distributions, Although QMLE's are not necessarily consistent, the Monte Carlo results show that the 2QMLE may be used as an alternative to MLE when MLE is not applicable in practice.

  • PDF

Integration of Multi-spectral Remote Sensing Images and GIS Thematic Data for Supervised Land Cover Classification

  • Jang Dong-Ho;Chung Chang-Jo F
    • Korean Journal of Remote Sensing
    • /
    • v.20 no.5
    • /
    • pp.315-327
    • /
    • 2004
  • Nowadays, interests in land cover classification using not only multi-sensor images but also thematic GIS information are increasing. Often, although useful GIS information for the classification is available, the traditional MLE (maximum likelihood estimation techniques) does not allow us to use the information, due to the fact that it cannot handle the GIS data properly. This paper propose two extended MLE algorithms that can integrate both remote sensing images and GIS thematic data for land-cover classification. They include modified MLE and Bayesian predictive likelihood estimation technique (BPLE) techniques that can handle both categorical GIS thematic data and remote sensing images in an integrated manner. The proposed algorithms were evaluated through supervised land-cover classification with Landsat ETM+ images and an existing land-use map in the Gongju area, Korea. As a result, the proposed method showed considerable improvements in classification accuracy, when compared with other multi-spectral classification techniques. The integration of remote sensing images and the land-use map showed that overall accuracy indicated an improvement in classification accuracy of 10.8% when using MLE, and 9.6% for the BPLE. The case study also showed that the proposed algorithms enable the extraction of the area with land-cover change. In conclusion, land cover classification results produced through the integration of various GIS spatial data and multi-spectral images, will be useful to involve complementary data to make more accurate decisions.