• Title/Summary/Keyword: 로버스트추정

Search Result 74, Processing Time 0.017 seconds

Data Communication Prediction Model in Multiprocessors based on Robust Estimation (로버스트 추정을 이용한 다중 프로세서에서의 데이터 통신 예측 모델)

  • Jun Janghwan;Lee Kangwoo
    • The KIPS Transactions:PartA
    • /
    • v.12A no.3 s.93
    • /
    • pp.243-252
    • /
    • 2005
  • This paper introduces a noble modeling technique to build data communication prediction models in multiprocessors, using Least-Squares and Robust Estimation methods. A set of sample communication rates are collected by using a few small input data sets into workload programs. By applying estimation methods to these samples, we can build analytic models that precisely estimate communication rates for huge input data sets. The primary advantage is that, since the models depend only on data set size not on the specifications of target systems or workloads, they can be utilized to various systems and applications. In addition, the fact that the algorithmic behavioral characteristics of workloads are reflected into the models entitles them to model diverse other performance metrics. In this paper, we built models for cache miss rates which are the main causes of data communication in shared memory multiprocessor systems. The results present excellent prediction error rates; below $1\%$ for five cases out of 12, and about $3\%$ for the rest cases.

Inversion of Geophysical Data with Robust Estimation (로버스트추정에 의한 지구물리자료의 역산)

  • Kim, Hee Joon
    • Economic and Environmental Geology
    • /
    • v.28 no.4
    • /
    • pp.433-438
    • /
    • 1995
  • The most popular minimization method is based on the least-squares criterion, which uses the $L_2$ norm to quantify the misfit between observed and synthetic data. The solution of the least-squares problem is the maximum likelihood point of a probability density containing data with Gaussian uncertainties. The distribution of errors in the geophysical data is, however, seldom Gaussian. Using the $L_2$ norm, large and sparsely distributed errors adversely affect the solution, and the estimated model parameters may even be completely unphysical. On the other hand, the least-absolute-deviation optimization, which is based on the $L_1$ norm, has much more robust statistical properties in the presence of noise. The solution of the $L_1$ problem is the maximum likelihood point of a probability density containing data with longer-tailed errors than the Gaussian distribution. Thus, the $L_1$ norm gives more reliable estimates when a small number of large errors contaminate the data. The effect of outliers is further reduced by M-fitting method with Cauchy error criterion, which can be performed by iteratively reweighted least-squares method.

  • PDF

On the Efficiency of Outlier Cleaners in Spatial Data Analysis (공간통계분석에서 이상점 수정방법의 효율성비교)

  • 이진희;신기일
    • The Korean Journal of Applied Statistics
    • /
    • v.17 no.2
    • /
    • pp.327-336
    • /
    • 2004
  • Many researchers have used the robust variogram to reduce the effect of outliers in spatial data analysis. Recently it is known that estimating the variogram after replacing outliers is more efficient. In this paper, we suggest a new data cleaner for geostatistic data analysis and compare the efficiency of outlier cleaners.

LAD Estimators for Categorical Data Analysis (범주형 자료 분석을 위한 LAD 추정량)

  • 최현집
    • The Korean Journal of Applied Statistics
    • /
    • v.16 no.1
    • /
    • pp.55-69
    • /
    • 2003
  • In this article, we propose the weighted LAD (least absolute deviations) estimators for multi-dimensional contingency tables and drive an estimation method to estimate the proposed estimators. To illustrate the robustness of the estimators, simulation results are presented for several models Including log-linear models and models for ordinal variables in multidimensional contingency tables. Examples were also introduced.

Bootstrapping trimmed estimator in statistical inference (붓스트랩방법을 활용한 절사추정량의 이론 및 응용연구)

  • 이재창;전명식;강창완
    • The Korean Journal of Applied Statistics
    • /
    • v.9 no.2
    • /
    • pp.1-11
    • /
    • 1996
  • As an estimate of a location parameter for a given data set, $\alpha$-trimmed mean has been studied for a long time by many statisticians because of its nice propoerties including robustness. However, its performance depends on the proportion of trimming say $\alpha$. In this paper, we suggest a data-driven choice of $\alpha$ and study its validity. Also, we suggest a new estimator and consider double-bootstrap to improve its performance. By using simulation study, the proposed method is compared with the exiting one in various cases. Real data sets are also analyzed by using the proposed method.

  • PDF

일반혼합이항모형에서 평가일치도의 로버스트 추정

  • 엄종석
    • Communications for Statistical Applications and Methods
    • /
    • v.2 no.2
    • /
    • pp.74-84
    • /
    • 1995
  • 혼합이항모형은 생물학, 혹은 심리학분야에서 많이 다루는 모형이다. 이 혼합모형에서 진단자간의 일치도를 나타내는 k 는 이항모형에 혼합되어지는 사전분포 $\xi$(p)에 따라 다른 형태를 갖는다. 그래서 $\xi$(p)에 의존적이지 않은 모수를 정의 하고, 이에 대한 실증적 추정값 $\hat k$을 일반혼합이항모형에서 k에 대한 추정값으로 사용하였다. 매개모수의 영향을 줄이기 위하여 모수를 직교화하였다. 베타이항모형으로 부터 표본을 추출하여 구한 최우추정값 $\hat k_m$과 이 표본을 이용하여 구한 $\hat k$을 비교하여 본 결과 k와 $\lambda$가 직교하는 영역에서 $\hat k$$\hat k_m$보다 편기가 작아지는 경우가 있을 만큼 $\hat k$이 효과적이었다.

  • PDF

A Trimmed Spatial Median Estimator Using Bootstrap Method (붓스트랩을 활용한 최적 절사공간중위수 추정량)

  • Lee, Dong-Hee;Jung, Byoung-Cheol
    • The Korean Journal of Applied Statistics
    • /
    • v.23 no.2
    • /
    • pp.375-382
    • /
    • 2010
  • In this study, we propose a robust estimator of the multivariate location parameter by means of the spatial median based on data trimming which extending trimmed mean in the univariate setup. The trimming quantity of this estimator is determined by the bootstrap method, and its covariance matrix is estimated by using the double bootstrap method. This extends the work of Jhun et al. (1993) to the multivariate case. Monte Carlo study shows that the proposed trimmed spatial median estimator yields better efficiency than a spatial median, while its covariance matrix based on double bootstrap overcomes the under-estimating problem occurred on single bootstrap method.

L-Estimation for the Parameter of the AR(l) Model (AR(1) 모형의 모수에 대한 L-추정법)

  • Han Sang Moon;Jung Byoung Cheal
    • The Korean Journal of Applied Statistics
    • /
    • v.18 no.1
    • /
    • pp.43-56
    • /
    • 2005
  • In this study, a robust estimation method for the first-order autocorrelation coefficient in the time series model following AR(l) process with additive outlier(AO) is investigated. We propose the L-type trimmed least squares estimation method using the preliminary estimator (PE) suggested by Rupport and Carroll (1980) in multiple regression model. In addition, using Mallows' weight function in order to down-weight the outlier of X-axis, the bounded-influence PE (BIPE) estimator is obtained and the mean squared error (MSE) performance of various estimators for autocorrelation coefficient are compared using Monte Carlo experiments. From the results of Monte-Carlo study, the efficiency of BIPE(LAD) estimator using the generalized-LAD to preliminary estimator performs well relative to other estimators.

Quantile regression using asymmetric Laplace distribution (비대칭 라플라스 분포를 이용한 분위수 회귀)

  • Park, Hye-Jung
    • Journal of the Korean Data and Information Science Society
    • /
    • v.20 no.6
    • /
    • pp.1093-1101
    • /
    • 2009
  • Quantile regression has become a more widely used technique to describe the distribution of a response variable given a set of explanatory variables. This paper proposes a novel modelfor quantile regression using doubly penalized kernel machine with support vector machine iteratively reweighted least squares (SVM-IRWLS). To make inference about the shape of a population distribution, the widely popularregression, would be inadequate, if the distribution is not approximately Gaussian. We present a likelihood-based approach to the estimation of the regression quantiles that uses the asymmetric Laplace density.

  • PDF

An Adaptive RLR L-Filter for Noise Reduction in Images (영상의 잡음 감소를 위한 적응 RLR L-필터)

  • Kim, Soo-Yang;Bae, Sung-Ha
    • Journal of Korea Multimedia Society
    • /
    • v.12 no.1
    • /
    • pp.26-30
    • /
    • 2009
  • We propose an adaptive Recursive Least Rank(RLR) L-filter which uses an L-estimator in order statistics and is based on rank estimate in robust statistics. The proposed RLR L-filter is a non-linear adaptive filter using non-linear adaptive algorithm and adapts itself to optimal filter in the sense of least dispersion measure of errors with non-homogeneous step size. Therefore the filter may be suitable for applications when the transmission channel is nonlinear channels such as Gaussian noise or impulsive noise, or when the signal is non-stationary such as image signal.

  • PDF