• 제목/요약/키워드: Maximum likelihood estimation (MLE)

검색결과 149건 처리시간 0.028초

Regularity of Maximum Likelihood Estimation for ARCH Regression Model with Lagged Dependent Variables

  • Hwang, Sun Y.
    • Journal of the Korean Statistical Society
    • /
    • 제29권1호
    • /
    • pp.9-16
    • /
    • 2000
  • This article addresses the problem of maximum likelihood estimation in ARCH regression with lagged dependent variables. Some topics in asymptotics of the model such as uniform expansion of likelihood function and construction of a class of MLE are discussed, and the regularity property of MLE is obtained. The error process here is possibly non-Gaussian.

  • PDF

Bayesian and maximum likelihood estimation of entropy of the inverse Weibull distribution under generalized type I progressive hybrid censoring

  • Lee, Kyeongjun
    • Communications for Statistical Applications and Methods
    • /
    • 제27권4호
    • /
    • pp.469-486
    • /
    • 2020
  • Entropy is an important term in statistical mechanics that was originally defined in the second law of thermodynamics. In this paper, we consider the maximum likelihood estimation (MLE), maximum product spacings estimation (MPSE) and Bayesian estimation of the entropy of an inverse Weibull distribution (InW) under a generalized type I progressive hybrid censoring scheme (GePH). The MLE and MPSE of the entropy cannot be obtained in closed form; therefore, we propose using the Newton-Raphson algorithm to solve it. Further, the Bayesian estimators for the entropy of InW based on squared error loss function (SqL), precautionary loss function (PrL), general entropy loss function (GeL) and linex loss function (LiL) are derived. In addition, we derive the Lindley's approximate method (LiA) of the Bayesian estimates. Monte Carlo simulations are conducted to compare the results among MLE, MPSE, and Bayesian estimators. A real data set based on the GePH is also analyzed for illustrative purposes.

MPE-LPC음성합성에서 Maximum- Likelihood Estimation에 의한 Multi-Pulse의 크기와 위치 추정 (Multi-Pulse Amplitude and Location Estimation by Maximum-Likelihood Estimation in MPE-LPC Speech Synthesis)

  • 이기용;최홍섭;안수길
    • 대한전자공학회논문지
    • /
    • 제26권9호
    • /
    • pp.1436-1443
    • /
    • 1989
  • In this paper, we propose a maximum-likelihood estimation(MLE) method to obtain the location and the amplitude of the pulses in MPE( multi-pulse excitation)-LPC speech synthesis using multi-pulses as excitation source. This MLE method computes the value maximizing the likelihood function with respect to unknown parameters(amplitude and position of the pulses) for the observed data sequence. Thus in the case of overlapped pulses, the method is equivalent to Ozawa's crosscorrelation method, resulting in equal amount of computation and sound quality with the cross-correlation method. We show by computer simulation: the multi-pulses obtained by MLE method are(1) pseudo-periodic in pitch in the case of voicde sound, (2) the pulses are random for unvoiced sound, (3) the pulses change from random to periodic in the interval where the original speech signal changes from unvoiced to voiced. Short time power specta of original speech and syunthesized speech obtained by using multi-pulses as excitation source are quite similar to each other at the formants.

  • PDF

수중 다중경로 주파수 선택적 채널에서 최대우도추정을 적용한 선택적합성 주파수 다이버시티의 통신 성능 (Communication performance of selective combining frequency diversity with maximum likelihood estimation in underwater multipath frequency selective channels)

  • 이채희;박규칠;박지현
    • 한국음향학회지
    • /
    • 제41권2호
    • /
    • pp.143-149
    • /
    • 2022
  • 본 논문은 최대우도추정(Maximum Likelihood Estimation, MLE)을 적용한 선택적 합성법(Selective Combining, SC)의 수중 주파수 다이버시티 통신성능을 평가하였다. 수중 다중경로 주파수 선택적 채널에서 수신 신호의 지연확산에 따른 상쇄 간섭 페이딩(destructive interference fading)은 수중 음향 통신 시스템의 오류 증가와 신호대잡음비(Signal to Noise Ratio, SNR)변동성에 영향을 준다. SC의 결정 값 추출을 위한 MLE 적용 해상실험에서 SC 주파수 다이버시티와 MLE-SC 주파수 다이버시티 성능을 평가하였다. SC보다 MLE-SC를 통해 추출한 결정 값을 적용한 경우 상대적으로 낮은 BER(Bit Error Rate) 특성을 확인하였다.

외국어 발음오류 검출 음성인식기를 위한 MCE 학습 알고리즘 (MCE Training Algorithm for a Speech Recognizer Detecting Mispronunciation of a Foreign Language)

  • 배민영;정용주;권철홍
    • 음성과학
    • /
    • 제11권4호
    • /
    • pp.43-52
    • /
    • 2004
  • Model parameters in HMM based speech recognition systems are normally estimated using Maximum Likelihood Estimation(MLE). The MLE method is based mainly on the principle of statistical data fitting in terms of increasing the HMM likelihood. The optimality of this training criterion is conditioned on the availability of infinite amount of training data and the correct choice of model. However, in practice, neither of these conditions is satisfied. In this paper, we propose a training algorithm, MCE(Minimum Classification Error), to improve the performance of a speech recognizer detecting mispronunciation of a foreign language. During the conventional MLE(Maximum Likelihood Estimation) training, the model parameters are adjusted to increase the likelihood of the word strings corresponding to the training utterances without taking account of the probability of other possible word strings. In contrast to MLE, the MCE training scheme takes account of possible competing word hypotheses and tries to reduce the probability of incorrect hypotheses. The discriminant training method using MCE shows better recognition results than the MLE method does.

  • PDF

SEM 파라메타 측정에 대한 MLE 기법과 POF 기법의 성능비교 (Preformance Comparison of MLE Technique with POF(Pencil of Functions) Method for SEM Parameter Estimation)

  • 김덕년
    • 한국정보처리학회논문지
    • /
    • 제1권4호
    • /
    • pp.511-516
    • /
    • 1994
  • 본 논문에서는 전송 잡음 환경 하에서 전자파 산란 물체의 식별을 위하여 사용하 는 파라메타 측정 기법에 관한 연구이다. 최대 유사측정(Maximum Likelihood Estimation : MLE)기법은 물체 식별에 변형하여 응용되면 종래 잘 알려져 사용되어온 함수군속(Pencil of Functions) 기법보다 더 좋은 측정결과를 가진다는 것을 본 논문 은 보여주고 있다. MLE 기법을 포함하여 파라메타 식별을 위한 도구로서 지금까지 여러 제안기법들이 있었으나, 본 논문에서는 샘플 데이타의 길이에 관계없이 목표시 스템의 파라메타 양에만 관계하는 최소단위의 메트릭스 연산이 사용됨을 보여주므로 잡음이 상재하는 추출 데이타로부터 목표식별에 가장 강한 강점이 있다.

  • PDF

Estimation for the Half Logistic Distribution Based on Double Hybrid Censored Samples

  • Kang, Suk-Bok;Cho, Young-Seuk;Han, Jun-Tae
    • Communications for Statistical Applications and Methods
    • /
    • 제16권6호
    • /
    • pp.1055-1066
    • /
    • 2009
  • Many articles have considered a hybrid censoring scheme, which is a mixture of Type-I and Type-II censoring schemes. We introduce a double hybrid censoring scheme and derive some approximate maximum likelihood estimators(AMLEs) of the scale parameter for the half logistic distribution under the proposed double hybrid censored samples. The scale parameter is estimated by approximate maximum likelihood estimation method using two different Taylor series expansion types. We also obtain the maximum likelihood estimator(MLE) and the least square estimator(LSE) of the scale parameter under the proposed double hybrid censored samples. We compare the proposed estimators in the sense of the mean squared error. The simulation procedure is repeated 10,000 times for the sample size n = 20(10)40 and various censored samples. The performances of the AMLEs and MLE are very similar in all aspects but the MLE and LSE have not a closed-form expression, some numerical method must be employed.

와이블분포 하에서 베이지안 기법과 전통적 기법 간의 신뢰도 추정 정확도 비교 (A Comparison of the Reliability Estimation Accuracy between Bayesian Methods and Classical Methods Based on Weibull Distribution)

  • 조형준;임준형;김용수
    • 대한산업공학회지
    • /
    • 제42권4호
    • /
    • pp.256-262
    • /
    • 2016
  • The Weibull is widely used in reliability analysis, and several studies have attempted to improve estimation of the distribution's parameters. least squares estimation (LSE) or Maximum likelihood estimation (MLE) are often used to estimate distribution parameters. However, it has been proven that Bayesian methods are more suitable for small sample sizes than LSE and MLE. In this work, the Weibull parameter estimation accuracy of LSE, MLE, and Bayesian method are compared for sample sets with 3 to 30 data points. The Bayesian method was most accurate for sample sizes under 25, and the accuracy of the Bayesian method was similar to LSE and MLE as the sample size increased.

절삭된 연립방정식 모형의 추정에 대한 몬테칼로 비교 (Estimation of nonlinear censored simultaneous equations models : An Application of Quasi Maximum Likelihood Methods)

  • 이회경
    • 응용통계연구
    • /
    • 제4권1호
    • /
    • pp.13-24
    • /
    • 1991
  • 절산된 선형의 단일방정식 회귀모형의 추정은 Tobin(1958)에 의하여 처음으로 조사된 후 Amemiya(1973)를 기점으로 활발한 연구가 진행되었으나, 절삭된 비선형의 연립방정식 모형에 대하여는 연구결과가 거의 전무한 상태이다. 본 논문에서는 단순한 형태의 절삭된 비선형 연립방정식 모형을 가정하고 이 모형을 대상으로 몇가지 가능한 추정방법들 즉, 구조방정식에 대한 최우추정량(MLE)과 Lee and Hurd(1989)에서 소개된 2단계 준최우추정량(2QMLE) 및 또 다른 대안이 될 수 있는 추정량을 서로 몬테칼로 방법으로 비교 검토하였다. 그 결과 MLE의 적용이 실제적으로 불가능한 상황에서는 2QMLE가 MLE의 대안으로 충분히 사용될 수 있음을 보여 주었다.

  • PDF

Integration of Multi-spectral Remote Sensing Images and GIS Thematic Data for Supervised Land Cover Classification

  • Jang Dong-Ho;Chung Chang-Jo F
    • 대한원격탐사학회지
    • /
    • 제20권5호
    • /
    • pp.315-327
    • /
    • 2004
  • Nowadays, interests in land cover classification using not only multi-sensor images but also thematic GIS information are increasing. Often, although useful GIS information for the classification is available, the traditional MLE (maximum likelihood estimation techniques) does not allow us to use the information, due to the fact that it cannot handle the GIS data properly. This paper propose two extended MLE algorithms that can integrate both remote sensing images and GIS thematic data for land-cover classification. They include modified MLE and Bayesian predictive likelihood estimation technique (BPLE) techniques that can handle both categorical GIS thematic data and remote sensing images in an integrated manner. The proposed algorithms were evaluated through supervised land-cover classification with Landsat ETM+ images and an existing land-use map in the Gongju area, Korea. As a result, the proposed method showed considerable improvements in classification accuracy, when compared with other multi-spectral classification techniques. The integration of remote sensing images and the land-use map showed that overall accuracy indicated an improvement in classification accuracy of 10.8% when using MLE, and 9.6% for the BPLE. The case study also showed that the proposed algorithms enable the extraction of the area with land-cover change. In conclusion, land cover classification results produced through the integration of various GIS spatial data and multi-spectral images, will be useful to involve complementary data to make more accurate decisions.