• Communications for Statistical Applications and Methods
• /
• v.19 no.1
• /
• pp.23-32
• /
• 2012

This paper deals with the bias and variance of regression coefficient estimators in a finite population. We derive approximate formulas for the bias, variance and mean square error of two estimators when we select a fixed-size inclusion probability proportional to the size sample and then estimate regression coefficients by the ordinary least square estimator as well as the weighted least square estimator based on the selected sample data. Necessary and sufficient conditions for the comparison of the two estimators in terms of variance and mean square error are suggested. In addition, a simple example is introduced to numerically compare the variance and mean square error of the two estimators.

• Survey Research
• /
• v.10 no.1
• /
• pp.141-154
• /
• 2009

With the current sampling scheme, the sampling variance is getting larger in producing smaller regional statistics than the designed area, The larger sample size can make the variance reduced but the efficiency of sample survey lower. The desired confidence level of sampling survey can be obtained using the current sample scheme with the same sample size and administrative data. In this paper, the number of the unemployed of 5 regions in Daejon are estimated using small area estimation methods and the CV values in each estimation method is calculated and compared for their estimation efficiency as empirical study. Jackknife method is proposed to estimate the MSE of synthetic estimator and composite estimator more accurately.

• Journal of the Korean Data and Information Science Society
• /
• v.20 no.2
• /
• pp.251-260
• /
• 2009

In this study, we propose a new estimation method based on autocovariance for selecting optimal estimators of the regression coefficients in the simple linear regression model. Although this method does not seem to be intuitively attractive, these estimators are unbiased for the corresponding regression coefficients. When the exploratory variable takes the equally spaced values between 0 and 1, under mild conditions which are satisfied when errors follow an autoregressive moving average model, we show that these estimators have asymptotically the same distributions as the least squares estimators. Additionally, under the same conditions as before, we provide a self-contained proof that these estimators converge in probability to the corresponding regression coefficients.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2010.11a
• /
• pp.167-170
• /
• 2010

잡음 분산 값은 SNR(signal-to-noise ratio) 추정이나 MMSE(minimum mean square error) 계산, 채널 임펄스 응답의 추정 등에 사용되는 중요한 파라미터이다. 채널이 시간에 따라 변하는 무선 통신 환경에서, 신호와 섞여 있는 잡음과 간섭 신호의 정확한 추정에는 그 한계가 있으며 이로 인해 발생하는 추정 오차는 수신기의 데이터 검출 성능을 저하시킨다. 훈련열을 이용하여 채널을 추정하였을 경우 추정된 채널 임펄스 응답 신호 중 다중 경로 신호는 소수에 불과하고 나머지 대부분의 계수는 잡음 성분만을 포함하는 신호이다. 이러한 특징을 이용하여 채널의 추정 계수로 잡음 분산을 추정하는 방법이 기존에 제시되어 있다. 여기서 제안하는 알고리즘은 기존 알고리즘인 PSA(partial sample average)와 비교해 연산량에서 차이가 거의 없이 구현되며, 3GPP TDD[1]에서의 모의 실험을 통하여 기존 알고리즘보다 더 정확한 분산 값을 찾아냄을 확인하였다.

• The Korean Journal of Applied Statistics
• /
• v.6 no.2
• /
• pp.393-399
• /
• 1993

When we compute the maximum likelihood estimators of the parameters for the logistic regression models, which are useful in studying the relationship between the binary response variable and the explanatory variable, the standard error calculations are usually based on the second derivative of log-likelihood function. On the other hand, an estimator of the Fisher information motivated from the fact that the expectation of the cross-product of the first derivative of the log-likelihood function gives the Fisher information is expected to have similar asymptotic properties. These estimators of Fisher information are closely related with the iterative algorithm to get the maximum likelihood estimator. The average numbers of iterations to achieve the maximum likelihood estimator are compared to find out which method is more efficient, and the estimators of the variance from each method are compared as estimators of the asymptotic variance.

• Survey Research
• /
• v.12 no.3
• /
• pp.49-62
• /
• 2011

In this paper we investigate design-based properties of both the ordinary least square estimator and the weighted least square estimator for regression coefficients in panel regression model. We derive formulas of approximate bias, variance and mean square error for the ordinary least square estimator and approximate variance for the weighted least square estimator after linearization of least square estimators. Also we compare their magnitudes each other numerically through a simulation study. We consider a three years data of Korean Welfare Panel Study as a finite population and take household income as a dependent variable and choose 7 exploratory variables related household as independent variables in panel regression model. Then we calculate approximate bias, variance, mean square error for the ordinary least square estimator and approximate variance for the weighted least square estimator based on several sample sizes from 50 to 1,000 by 50. Through the simulation study we found some tendencies as follows. First, the mean square error of the ordinary least square estimator is getting larger than the variance of the weighted least square estimator as sample sizes increase. Next, the magnitude of mean square error of the ordinary least square estimator is depending on the magnitude of the bias of the estimator, which is large when the bias is large. Finally, with regard to approximate variance, variances of the ordinary least square estimator are smaller than those of the weighted least square estimator in many cases in the simulation.

• Journal of Korean Society for Quality Management
• /
• v.10 no.1
• /
• pp.2-6
• /
• 1982

Suppose a system with m components is subjected to a random stress. We consider the estimation of reliability when data consist of random samples from the stress distribution and the strength distributions. All the distributions are assumed to be independent exponential with unknown scale parameters. An explicit form of system reliability and the minimun variance unbiased estimator are obtained. The asymptotic distribution is also obtained by expanding the minimum variance unbiased estimator about the maximum likelihood estimator and establishing their equivalance. The performance of the two estimators is compared by Monte Carlo Simulation.

• The Korean Journal of Applied Statistics
• /
• v.10 no.2
• /
• pp.367-374
• /
• 1997

In panel surveys it is necessary to manage both sampling frame and sample units across time. When sample is updated according to the change of its frame, it should be incorporated in the estimation procedure. This paper derives the bias of the conventional estimator caused by neglecting the change of sample, and provides a bias-adjusted estimator with its variance.

• The Korean Journal of Applied Statistics
• /
• v.29 no.4
• /
• pp.595-611
• /
• 2016

We use nonlinear regression models (such as the Hill Model) when we analyze data in toxicology and/or pharmacology. In nonlinear regression models an estimator of parameters and estimation of measurement about uncertainty of the estimator are influenced by the variance structure of the error. Thus, estimation methods should be different depending on whether the data are homoscedastic or heteroscedastic. However, we do not know the variance structure of the error until we actually analyze the data. Therefore, developing estimation methods robust to the variance structure of the error is an important problem. In this paper we propose a method to estimate parameters in nonlinear regression models based on a preliminary test. We define an estimator which uses either the ordinary least square estimation method or the iterative weighted least square estimation method according to the results of a simple preliminary test for the equality of the error variance. The performance of the proposed estimator is compared to those of existing estimators by simulation studies. We also compare estimation methods using real data obtained from the National Toxicology program of the United States.

• Journal of Korea Water Resources Association
• /
• v.32 no.4
• /
• pp.437-445
• /
• 1999

The present paper describes the problem of hydrologic response estimation using non-parametric ridge regression method. The method adapted in this work is based on the minimization of the $C_L$ statistics, which is an estimate of the mean square prediction error. For this method, effects of using both the identity matrix and the Laplacian matrix were considered. In addition, we evaluated methods for estimating the error variance of the impulse response. As a result of analyzing synthetic and real data, a good estimation was made when the Laplacian matrix for the weighting matrix and the bias corrected estimate for the error variance were used. The method and procedure presented in present paper will play a robust and effective role on separating hydrologic response.