• Title/Summary/Keyword: Least median of squares

Search Result 28, Processing Time 0.026 seconds

Robust Estimation and Outlier Detection

  • Myung Geun Kim
    • Communications for Statistical Applications and Methods
    • /
    • v.1 no.1
    • /
    • pp.33-40
    • /
    • 1994
  • The conditional expectation of a random variable in a multivariate normal random vector is a multiple linear regression on its predecessors. Using this fact, the least median of squares estimation method developed in a multiple linear regression is adapted to a multivariate data to identify influential observations. The resulting method clearly detect outliers and it avoids the masking effect.

  • PDF

A Confirmation of Identified Multiple Outliers and Leverage Points in Linear Model (다중 선형 모형에서 식별된 다중 이상점과 다중 지렛점의 재확인 방법에 대한 연구)

  • 유종영;안기수
    • The Korean Journal of Applied Statistics
    • /
    • v.15 no.2
    • /
    • pp.269-279
    • /
    • 2002
  • We considered the problem for confirmation of multiple outliers and leverage points. Identification of multiple outliers and leverage points is difficult because of the masking effect and swamping effect. Rousseeuw and van Zomeren(1990) identified multiple outliers and leverage points by using the Least Median of Squares and Minimum Value of Ellipsoids which are high-breakdown robust estimators. But their methods tend to declare too many observations as extremes. Atkinson(1987) suggested a method for confirming of outliers and Fung(1993) pointed out Atkinson method's limitation and proposed another method by using the add-back model. But we analyzed that Fung's method is affected by adjacent effect. In this thesis, we proposed one procedure for confirmation of outliers and leverage points and compared three example with Fung's method.

Lens design by using damped least squares method with special procedure for estimating numerical adequacy of derivative increments of variables (미분증가치의 최적성 평가법을 도입한 감쇠최소자승법에 의한 광학 설계)

  • 김태희;김경찬;박진원;최옥식;이윤구;조현모;이인원
    • Korean Journal of Optics and Photonics
    • /
    • v.8 no.2
    • /
    • pp.88-94
    • /
    • 1997
  • Photographic lenses and an aspheric optical pickup-lens are designed by using damped least-squares(DLS) method. We start optimization with arbitrary initial damping factor. To improve the rate of convergence and the stability in optimization, we apply the special procedure that estimates numerical adequacy of derivative increments of variables to the DLS method. When the initial damping factor is almost equal to the median of series of eigenvalues, the convergence and the stability of the method significantly are improved. Optimized lenses have the performance of each target.

  • PDF

Identification of Regression Outliers Based on Clustering of LMS-residual Plots

  • Kim, Bu-Yong;Oh, Mi-Hyun
    • Communications for Statistical Applications and Methods
    • /
    • v.11 no.3
    • /
    • pp.485-494
    • /
    • 2004
  • An algorithm is proposed to identify multiple outliers in linear regression. It is based on the clustering of residuals from the least median of squares estimation. A cut-height criterion for the hierarchical cluster tree is suggested, which yields the optimal clustering of the regression outliers. Comparisons of the effectiveness of the procedures are performed on the basis of the classic data and artificial data sets, and it is shown that the proposed algorithm is superior to the one that is based on the least squares estimation. In particular, the algorithm deals very well with the masking and swamping effects while the other does not.

A Hybrid Algorithm for Identifying Multiple Outlers in Linear Regression

  • Kim, Bu-yong;Kim, Hee-young
    • Communications for Statistical Applications and Methods
    • /
    • v.9 no.1
    • /
    • pp.291-304
    • /
    • 2002
  • This article is concerned with an effective algorithm for the identification of multiple outliers in linear regression. It proposes a hybrid algorithm which employs the least median of squares estimator, instead of the least squares estimator, to construct an Initial clean subset in the stepwise forward search scheme. The performance of the proposed algorithm is evaluated and compared with the existing competitor via an extensive Monte Carlo simulation. The algorithm appears to be superior to the competitor for the most of scenarios explored in the simulation study. Particularly it copes with the masking problem quite well. In addition, the orthogonal decomposition and Its updating techniques are considered to improve the computational efficiency and numerical stability of the algorithm.

Decision function for optimal smoothing parameter of asymmetrically reweighted penalized least squares (Asymetrically reweighted penalized least squares에서 최적의 평활화 매개변수를 위한 결정함수)

  • Park, Aa-Ron;Park, Jun-Kyu;Ko, Dae-Young;Kim, Sun-Geum;Baek, Sung-June
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.20 no.3
    • /
    • pp.500-506
    • /
    • 2019
  • In this study, we present a decision function of optimal smoothing parameter for baseline correction using Asymmetrically reweighted penalized least squares (arPLS). Baseline correction is very important due to influence on performance of spectral analysis in application of spectroscopy. Baseline is often estimated by parameter selection using visual inspection on analyte spectrum. It is a highly subjective procedure and can be tedious work especially with a large number of data. For these reasons, an objective procedure is necessary to determine optimal parameter value for baseline correction. The proposed function is defined by modeling the median value of possible parameter range as the length and order of the background signal. The median value increases as the length of the signal increases and decreases as the degree of the signal increases. The simulated data produced a total of 112 signals combined for the 7 lengths of the signal, adding analytic signals and linear and quadratic, cubic and 4th order curve baseline respectively. According to the experimental results using simulated data with linear, quadratic, cubic and 4th order curved baseline, and real Raman spectra, we confirmed that the proposed function can be effectively applied to optimal parameter selection for baseline correction using arPLS.

ROBUST UNIT ROOT TESTS FOR SEASONAL AUTOREGRESSIVE PROCESS

  • Oh, Yu-Jin;So, Beong-Soo
    • Journal of the Korean Statistical Society
    • /
    • v.33 no.2
    • /
    • pp.149-157
    • /
    • 2004
  • The stationarity is one of the most important properties of a time series. We propose robust sign tests for seasonal autoregressive processes to determine whether or not a time series is stationary. The proposed tests are robust to the outliers and the heteroscedastic errors, and they have an exact binomial null distribution regardless of the period of seasonality and types of median adjustments. A Monte-Carlo simulation shows that the sign test is locally more powerful than the tests based on ordinary least squares estimator (OLSE) for heavy-tailed and/or heteroscedastic error distributions.

Robustness of Minimum Disparity Estimators in Linear Regression Models

  • Pak, Ro-Jin
    • Journal of the Korean Statistical Society
    • /
    • v.24 no.2
    • /
    • pp.349-360
    • /
    • 1995
  • This paper deals with the robustness properties of the minimum disparity estimation in linear regression models. The estimators defined as statistical quantities whcih minimize the blended weight Hellinger distance between a weighted kernel density estimator of the residuals and a smoothed model density of the residuals. It is shown that if the weights of the density estimator are appropriately chosen, the estimates of the regression parameters are robust.

  • PDF

An Adaptive M-estimators Robust Estimation Algorithm (적응적 M-estimators 강건 예측 알고리즘)

  • Jang Seok-Woo;Kim Jin-Uk
    • Journal of the Korea Society of Computer and Information
    • /
    • v.10 no.2 s.34
    • /
    • pp.21-30
    • /
    • 2005
  • In general, the robust estimation method is well known for a good statistical estimator that is insensitive to small departures from the idealized assumptions for which the estimation is optimized. While there are many existing robust estimation techniques that have been proposed in the literature, two main techniques used in computer vision are M-estimators and least-median of squares (LMS). Among these. we utilized the M-estimators since they are known to provide an optimal estimation of affine motion parameters. The M-estimators have higher statistical efficiency but tolerate much lower percentages of outliers unless properly initialized. To resolve these problems, we proposed an adaptive M-estimators algorithm that effectively separates outliers from non-outliers and estimate affine model parameters, using a continuous sigmoid weight function. The experimental results show the superiority of our method.

  • PDF

Range Image Segmentation Using Robust Regression (Robust 회귀분석을 이용한 거리영상 분할)

  • 이길무;박래홍
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.32B no.7
    • /
    • pp.974-988
    • /
    • 1995
  • In this paper, we propose a range image segmentation algorithm using robust regression. We derive a least $\kappa$th-order square (LKS) method by generalizing the least median of squares (LMedS) method and compare it with the conventional robust regressions. The LKS is robuster against outliers than the LMedS and shows performance similar to the residual consensus (RESC). The RESC uses the predetermined number of sorted residuals, whereas the LKS uses an adaptive parameter determined by given observations rather than the a priori knowledge. Computer simulation with synthetic and real range images shows that the proposed LKS algorithm gives better performance than the conventional ones.

  • PDF