• 제목/요약/키워드: Log-likelihood function

검색결과 95건 처리시간 0.026초

On Practical Efficiency of Locally Parametric Nonparametric Density Estimation Based on Local Likelihood Function

  • Kang, Kee-Hoon;Han, Jung-Hoon
    • Communications for Statistical Applications and Methods
    • /
    • 제10권2호
    • /
    • pp.607-617
    • /
    • 2003
  • This paper offers a practical comparison of efficiency between local likelihood approach and conventional kernel approach in density estimation. The local likelihood estimation procedure maximizes a kernel smoothed log-likelihood function with respect to a polynomial approximation of the log likelihood function. We use two types of data driven bandwidths for each method and compare the mean integrated squares for several densities. Numerical results reveal that local log-linear approach with simple plug-in bandwidth shows better performance comparing to the standard kernel approach in heavy tailed distribution. For normal mixture density cases, standard kernel estimator with the bandwidth in Sheather and Jones(1991) dominates the others in moderately large sample size.

MLE for Incomplete Contingency Tables with Lagrangian Multiplier

  • Kang, Shin-Soo
    • Journal of the Korean Data and Information Science Society
    • /
    • 제17권3호
    • /
    • pp.919-925
    • /
    • 2006
  • Maximum likelihood estimate(MLE) is obtained from the partial log-likelihood function for the cell probabilities of two way incomplete contingency tables proposed by Chen and Fienberg(1974). The partial log-likelihood function is modified by adding lagrangian multiplier that constraints can be incorporated with. Variances of MLE estimators of population proportions are derived from the matrix of second derivatives of the loglikelihood with respect to cell probabilities. Simulation results, when data are missing at random, reveal that Complete-case(CC) analysis produces biased estimates of joint probabilities under MAR and less efficient than either MLE or MI. MLE and MI provides consistent results under either the MAR situation. MLE provides more efficient estimates of population proportions than either multiple imputation(MI) based on data augmentation or complete case analysis. The standard errors of MLE from the proposed method using lagrangian multiplier are valid and have less variation than the standard errors from MI and CC.

  • PDF

Cox proportional hazard model with L1 penalty

  • Hwang, Chang-Ha;Shim, Joo-Yong
    • Journal of the Korean Data and Information Science Society
    • /
    • 제22권3호
    • /
    • pp.613-618
    • /
    • 2011
  • The proposed method is based on a penalized log partial likelihood of Cox proportional hazard model with L1-penalty. We use the iteratively reweighted least squares procedure to solve L1 penalized log partial likelihood function of Cox proportional hazard model. It provide the ecient computation including variable selection and leads to the generalized cross validation function for the model selection. Experimental results are then presented to indicate the performance of the proposed procedure.

Kernel Machine for Poisson Regression

  • Hwang, Chang-Ha
    • Journal of the Korean Data and Information Science Society
    • /
    • 제18권3호
    • /
    • pp.767-772
    • /
    • 2007
  • A kernel machine is proposed as an estimating procedure for the linear and nonlinear Poisson regression, which is based on the penalized negative log-likelihood. The proposed kernel machine provides the estimate of the mean function of the response variable, where the canonical parameter is related to the input vector in a nonlinear form. The generalized cross validation(GCV) function of MSE-type is introduced to determine hyperparameters which affect the performance of the machine. Experimental results are then presented which indicate the performance of the proposed machine.

  • PDF

Fault diagnosis based on likelihood decomposition

  • Uosaki, Katsuji;Kagawa, Tetsuo
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1992년도 한국자동제어학술회의논문집(국제학술편); KOEX, Seoul; 19-21 Oct. 1992
    • /
    • pp.272-275
    • /
    • 1992
  • A novel fault diagnosis method based on likelihood decomposition is proposed for linear stochastic systems described by autoregressive (AR) model. Assuming that at some time instant .tau. the fault of one of the following two types is occurs: innovation fault (actuator fault); and observation fault (sensor fault), the log-likelihood function is decomposed into two components based on the observations before and after .tau., respectively, Then, the type of the fault is determined by comparing the log-likelihoods corresponding two types of faults. Numerical examples demonstrate the usefulness of the proposed diagnosis method.

  • PDF

가능도함수를 이용한 불연속점 수의 추정 (Estimation of the number of discontinuity points based on likelihood)

  • 허집
    • Journal of the Korean Data and Information Science Society
    • /
    • 제21권1호
    • /
    • pp.51-59
    • /
    • 2010
  • 일반화선형모형에서 회귀함수가 하나의 불연속점을 가질 때, Huh (2009)는 하나의 모수를 가지는 지수족의 가능도함수를 한쪽방향커널을 이용하여 그 불연속점의 위치와 점프크기를 추정하였다. 이 논문에서는 미지의 불연속점 수 q개를 가지는 회귀함수인 경우에, Huh (2009)가 제안한 점프크기 추정량의 점근분포를 이용한 가설검정법을 소개하고, 그 가설검정법을 이용한 불연속점 수를 추정하는 알고리듬을 제안하고, 모의실험을 통하여 추정의 정도를 알아보고자 한다.

두 개의 맥스웰분포의 모수비에 대한 우도함수 추론 (Likelihood based inference for the ratio of parameters in two Maxwell distributions)

  • 강상길;이정희;이우동
    • Journal of the Korean Data and Information Science Society
    • /
    • 제23권1호
    • /
    • pp.89-98
    • /
    • 2012
  • 이 논문에서는 두 개의 Maxwell분포의 모수들의 동질성을 모수비에 근거하여 검정하는 근사통계량을 제안한다. Maxwell분포의 모수비에 대한 추정량이 복잡하여 정확한 분포를 유도하기는 매우 어렵다. 이러한 문제를 해결하기 위한 하나의 대안으로 표준정규분포로 근사적으로 수렴하는 통계량을 고려해야 한다. 이 논문에서 제안된 통계량은 표준정규분포로 수렴하며, 표본의 수가 작은 경우에도 사용할 수 있다. 특히, 본 논문에서는 부호화 로그 우도비 통계량과 수정된 부호화 로그 우도비 통계량을 개발한다. 일반적으로, 수정된 부호화 로그 우도비 통계량은 로그 우도비 통계량에 비해 표준정규분포로 수렴하는 속도가 매우 빠르다. 부호화 로그 우도비 통계량은 작은 표본으로도 표준정규분포로 매우 빨리 수렴한다. 제안된 통계량들의 성질들을 모의실험을 통하여 알아보고, 제안된 통계량을 예제를 통하여 연구한다.

Kernel Poisson regression for mixed input variables

  • Shim, Jooyong
    • Journal of the Korean Data and Information Science Society
    • /
    • 제23권6호
    • /
    • pp.1231-1239
    • /
    • 2012
  • An estimating procedure is introduced for kernel Poisson regression when the input variables consist of numerical and categorical variables, which is based on the penalized negative log-likelihood and the component-wise product of two different types of kernel functions. The proposed procedure provides the estimates of the mean function of the response variables, where the canonical parameter is linearly and/or nonlinearly related to the input variables. Experimental results are then presented which indicate the performance of the proposed kernel Poisson regression.

ALT 통합모형의 적용 및 응용 (Implementation and Application of Integrated Model for ALT(Accelerated Life Test))

  • 최성운
    • 대한안전경영과학회:학술대회논문집
    • /
    • 대한안전경영과학회 2008년도 추계학술대회
    • /
    • pp.153-160
    • /
    • 2008
  • This paper presents the log likelihood function for integrated models for ALT such as exponential-general Eyring, Weibull-temperature and specific heat, lognormal-temperature and specific heat. Additionally this paper estimates the system reliability and mean time to failure(MTTF) for series, parallel, k of n, and standby system using ALT linkage parameter. Lastly this study designs three variable reliability acceptance sampling(RAS) plans such as type I, II censored test, sequential test by the use of integrated models for ALT.

  • PDF

가능도함수를 이용한 로그분산함수의 불연속점 검정 (Testing of a discontinuity point in the log-variance function based on likelihood)

  • 허집
    • Journal of the Korean Data and Information Science Society
    • /
    • 제20권1호
    • /
    • pp.1-9
    • /
    • 2009
  • 회귀모형의 분산함수가 알려져 있지 않은 한 점에서 불연속이라 가정하자. Yu와 Jones (2004)는 음이 아닌 값을 취하는 분산함수를 실수 값을 취하도록 하기 위하여 로그 변환하였고, 변환된 로그분산함수를 국소다항적합으로 추정하였다. 로그분산함수의 국소다항적합을 이용하여, Huh (2008)는 분산함수의 불연속점의 추정하는 대신 로그분산함수의 불연속점을 추정하였다. 본 연구는 Huh의 점프의 크기 추정량의 점근분포를 이용하여 로그분산함수의 불연속점의 존재여부에 대한 가설검정을 제안하고, 제안한 방법에 대한 모의실험 결과를 제시하고자 한다.

  • PDF