• Title/Summary/Keyword: 가중평균제곱오차

Search Result 21, Processing Time 0.03 seconds

Design-Based Properties of Least Square Estimators of Panel Regression Coefficients Based on Complex Panel Data (복합패널 데이터에 기초한 최소제곱 패널회귀추정량의 설계기반 성질)

  • Kim, Kyu-Seong
    • Communications for Statistical Applications and Methods
    • /
    • v.17 no.4
    • /
    • pp.515-525
    • /
    • 2010
  • We investigated design-based properties of the ordinary least square estimator(OLSE) and the weighted least square estimator(WLSE) in a panel regression model. Given a complex data we derive the magnitude of the design-based bias of two estimators and show that the bias of WLSE is smaller than that of OLSE. We also conducted a simulation study using Korean welfare panel data in order to compare design-based properties of two estimators numerically. In the study we found the followings. First, the relative bias of OLSE is nearly two times larger than that of WLSE and the bias ratio of OLSE is greater than that of WLSE. Also the relative bias of OLSE remains steady but that of WLSE becomes smaller as the sample size increases. Next, both the variance and mean square error(MSE) of two estimators decrease when the sample size increases. Also there is a tendency that the proportion of squared bias in MSE of OLSE increases as the sample size increase, but that of WLSE decreases. Finally, the variance of OLSE is smaller than that of WLSE in almost all cases and the MSE of OLSE is smaller in many cases. However, the number of cases of larger MSE of OLSE increases when the sample size increases.

A Weighted Mean Squared Error Approach to Multiple Response Surface Optimization (다중반응표면 최적화를 위한 가중평균제곱오차)

  • Jeong, In-Jun;Cho, Hyun-Woo
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.14 no.2
    • /
    • pp.625-633
    • /
    • 2013
  • Multiple response surface optimization (MRSO) aims at finding a setting of input variables which simultaneously optimizes multiple responses. The minimization of mean squared error (MSE), which consists of the squared bias and variance terms, is an effective way to consider the location and dispersion effects of the responses in MRSO. This approach basically assumes that both the terms have an equal weight. However, they need to be weighted differently depending on a problem situation, for example, in case that they are not of the same importance. This paper proposes to use the weighted MSE (WMSE) criterion instead of the MSE criterion in MRSO to consider an unequal weight situation.

A Robust Design of Response Surface Methods (반응표면방법론에서의 강건한 실험계획)

  • 임용빈;오만숙
    • The Korean Journal of Applied Statistics
    • /
    • v.15 no.2
    • /
    • pp.395-403
    • /
    • 2002
  • In the third phase of the response surface methods, the first-order model is assumed and the curvature of the response surface is checked with a fractional factorial design augmented by centre runs. We further assume that a true model is a quadratic polynomial. To choose an optimal design, Box and Draper(1959) suggested the use of an average mean squared error (AMSE), an average of MSE of y(x) over the region of interest R. The AMSE can be partitioned into the average prediction variance (APV) and average squared bias (ASB). Since AMSE is a function of design moments, region moments and a standardized vector of parameters, it is not possible to select the design that minimizes AMSE. As a practical alternative, Box and Draper(1959) proposed minimum bias design which minimize ASB and showed that factorial design points are shrunk toward the origin for a minimum bias design. In this paper we propose a robust AMSE design which maximizes the minimum efficiency of the design with respect to a standardized vector of parameters.

A Weighted Mean Squared Error Approach Based on the Tchebycheff Metric in Multiresponse Optimization (Tchebycheff Metric 기반 가중평균제곱오차 최소화법을 활용한 다중반응표면 최적화)

  • Jeong, In-Jun
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.16 no.1
    • /
    • pp.97-105
    • /
    • 2015
  • Multiresponse optimization (MRO) seeks to find the setting of input variables, which optimizes the multiple responses simultaneously. The approach of weighted mean squared error (WMSE) minimization for MRO imposes a different weight on the squared bias and variance, which are the two components of the mean squared error (MSE). To date, a weighted sum-based method has been proposed for WMSE minimization. On the other hand, this method has a limitation in that it cannot find the most preferred solution located in a nonconvex region in objective function space. This paper proposes a Tchebycheff metric-based method to overcome the limitations of the weighted sum-based method.

Design-based Properties of Least Square Estimators in Panel Regression Model (패널회귀모형에서 회귀계수 추정량의 설계기반 성질)

  • Kim, Kyu-Seong
    • Survey Research
    • /
    • v.12 no.3
    • /
    • pp.49-62
    • /
    • 2011
  • In this paper we investigate design-based properties of both the ordinary least square estimator and the weighted least square estimator for regression coefficients in panel regression model. We derive formulas of approximate bias, variance and mean square error for the ordinary least square estimator and approximate variance for the weighted least square estimator after linearization of least square estimators. Also we compare their magnitudes each other numerically through a simulation study. We consider a three years data of Korean Welfare Panel Study as a finite population and take household income as a dependent variable and choose 7 exploratory variables related household as independent variables in panel regression model. Then we calculate approximate bias, variance, mean square error for the ordinary least square estimator and approximate variance for the weighted least square estimator based on several sample sizes from 50 to 1,000 by 50. Through the simulation study we found some tendencies as follows. First, the mean square error of the ordinary least square estimator is getting larger than the variance of the weighted least square estimator as sample sizes increase. Next, the magnitude of mean square error of the ordinary least square estimator is depending on the magnitude of the bias of the estimator, which is large when the bias is large. Finally, with regard to approximate variance, variances of the ordinary least square estimator are smaller than those of the weighted least square estimator in many cases in the simulation.

  • PDF

Weighting Effect on the Weighted Mean in Finite Population (유한모집단에서 가중평균에 포함된 가중치의 효과)

  • Kim, Kyu-Seong
    • Survey Research
    • /
    • v.7 no.2
    • /
    • pp.53-69
    • /
    • 2006
  • Weights can be made and imposed in both sample design stage and analysis stage in a sample survey. While in design stage weights are related with sample data acquisition quantities such as sample selection probability and response rate, in analysis stage weights are connected with external quantities, for instance population quantities and some auxiliary information. The final weight is the product of all weights in both stage. In the present paper, we focus on the weight in analysis stage and investigate the effect of such weights imposed on the weighted mean when estimating the population mean. We consider a finite population with a pair of fixed survey value and weight in each unit, and suppose equal selection probability designs. Under the condition we derive the formulas of the bias as well as mean square error of the weighted mean and show that the weighted mean is biased and the direction and amount of the bias can be explained by the correlation between survey variate and weight: if the correlation coefficient is positive, then the weighted mein over-estimates the population mean, on the other hand, if negative, then under-estimates. Also the magnitude of bias is getting larger when the correlation coefficient is getting greater. In addition to theoretical derivation about the weighted mean, we conduct a simulation study to show quantities of the bias and mean square errors numerically. In the simulation, nine weights having correlation coefficient with survey variate from -0.2 to 0.6 are generated and four sample sizes from 100 to 400 are considered and then biases and mean square errors are calculated in each case. As a result, in the case or 400 sample size and 0.55 correlation coefficient, the amount or squared bias of the weighted mean occupies up to 82% among mean square error, which says the weighted mean might be biased very seriously in some cases.

  • PDF

임의중단모형에서 신뢰도의 비모수적 통합형 추정량

  • 이재만;차영준;장덕준
    • Communications for Statistical Applications and Methods
    • /
    • v.5 no.3
    • /
    • pp.685-694
    • /
    • 1998
  • 임상실험이나 신뢰성공학 분야에서 임의 중단자료를 이용한 비모수적 신뢰도 추정량으로 Kaplan-Meier 추정량과 Nelson형 추정량이 많이 사용되고 있다. 그러나 Nelson형 추정량은 평균제곱오차의 관점에서 Kaplan-Meier 추정량보다 추정능력이 우수한 반면 편의는 신뢰도가 감소함에 따라 양의 방향으로 점증하는 소표본 특성을 갖는다. Nelson형 추정량의 이러한 특성 때문에 신뢰도의 함수로 표현되는 잔여수명 분위수함수 등의 추정시에는 평균제곱오차의 관점에서 Kaplan-Meier 추정량보다 추정능력이 떨어짐을 볼 수 있다. 이러한 점을 고려하여 이 두 추정량을 가중평균으로 통합한 새로운 비모수적 신뢰도 추정량을 제안하고 추정량의 특성을 비교 분석하였다.

  • PDF

Vocal separation method using weighted β-order minimum mean square error estimation based on kernel back-fitting (커널 백피팅 알고리즘 기반의 가중 β-지수승 최소평균제곱오차 추정방식을 적용한 보컬음 분리 기법)

  • Cho, Hye-Seung;Kim, Hyoung-Gook
    • The Journal of the Acoustical Society of Korea
    • /
    • v.35 no.1
    • /
    • pp.49-54
    • /
    • 2016
  • In this paper, we propose a vocal separation method using weighted ${\beta}$-order minimum mean wquare error estimation (WbE) based on kernel back-fitting algorithm. In spoken speech enhancement, it is well-known that the WbE outperforms the existing Bayesian estimators such as the minimum mean square error (MMSE) of the short-time spectral amplitude (STSA) and the MMSE of the logarithm of the STSA (LSA), in terms of both objective and subjective measures. In the proposed method, WbE is applied to a basic iterative kernel back-fitting algorithm for improving the vocal separation performance from monaural music signal. The experimental results show that the proposed method achieves better separation performance than other existing methods.

Comparison between Kriging and GWR for the Spatial Data (공간자료에 대한 지리적 가중회귀 모형과 크리깅의 비교)

  • Kim Sun-Woo;Jeong Ae-Ran;Lee Sung-Duck
    • The Korean Journal of Applied Statistics
    • /
    • v.18 no.2
    • /
    • pp.271-280
    • /
    • 2005
  • Kriging methods as traditional spatial data analysis methods and geographical weighted regression models as statistical analysis methods are compared. In this paper, we apply data from the Ministry of Environment to spatial analysis for practical study. We compare these methods to performance with monthly carbon monoxide observations taken at 116 measuring area of air pollution in 1999.

A Posterior Preference Articulation Method to the Weighted Mean Squared Error Minimization Approach in Multi-Response Surface Optimization (다중반응표면 최적화에서 가중평균제곱오차 최소화법을 위한 선호도사후제시법)

  • Jeong, In-Jun
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.16 no.10
    • /
    • pp.7061-7070
    • /
    • 2015
  • Multi-Response Surface Optimization aims at finding the optimal setting of input variables considering multiple responses simultaneously. The Weighted Mean Squared Error (WMSE) minimization approach, which imposes a different weight on the two components of mean squared error, squared bias and variance, first obtains WMSE for each response and then minimizes all the WMSEs at once. Most of the methods proposed for the WMSE minimization approach to date are classified into the prior preference articulation approach, which requires that a decision maker (DM) provides his/her preference information a priori. However, it is quite difficult for the DM to provide such information in advance, because he/she cannot experience the relationships or conflicts among the responses. To overcome this limitation, this paper proposes a posterior preference articulation method to the WMSE minimization approach. The proposed method first generates all (or most) of the nondominated solutions without the DM's preference information. Then, the DM selects the best one from the set of nondominated solutions a posteriori. Its advantage is that it provides an opportunity for the DM to understand the tradeoffs in the entire set of nondominated solutions and effectively obtains the most preferred solution suitable for his/her preference structure.