• Title/Summary/Keyword: robust regression

Search Result 360, Processing Time 0.029 seconds

V-mask Type Criterion for Identification of Outliers In Logistic Regression

  • Kim Bu-Yong
    • Communications for Statistical Applications and Methods
    • /
    • v.12 no.3
    • /
    • pp.625-634
    • /
    • 2005
  • A procedure is proposed to identify multiple outliers in the logistic regression. It detects the leverage points by means of hierarchical clustering of the robust distances based on the minimum covariance determinant estimator, and then it employs a V-mask type criterion on the scatter plot of robust residuals against robust distances to classify the observations into vertical outliers, bad leverage points, good leverage points, and regular points. Effectiveness of the proposed procedure is evaluated on the basis of the classic and artificial data sets, and it is shown that the procedure deals very well with the masking and swamping effects.

Range Image Segmentation Using Robust Regression (Robust 회귀분석을 이용한 거리영상 분할)

  • 이길무;박래홍
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.32B no.7
    • /
    • pp.974-988
    • /
    • 1995
  • In this paper, we propose a range image segmentation algorithm using robust regression. We derive a least $\kappa$th-order square (LKS) method by generalizing the least median of squares (LMedS) method and compare it with the conventional robust regressions. The LKS is robuster against outliers than the LMedS and shows performance similar to the residual consensus (RESC). The RESC uses the predetermined number of sorted residuals, whereas the LKS uses an adaptive parameter determined by given observations rather than the a priori knowledge. Computer simulation with synthetic and real range images shows that the proposed LKS algorithm gives better performance than the conventional ones.

  • PDF

Reexamination of Estimating Beta Coecient as a Risk Measure in CAPM

  • Phuoc, Le Tan;Kim, Kee S.;Su, Yingcai
    • The Journal of Asian Finance, Economics and Business
    • /
    • v.5 no.1
    • /
    • pp.11-16
    • /
    • 2018
  • This research examines the alternative ways of estimating the coefficient of non-diversifiable risk, namely beta coefficient, in Capital Asset Pricing Model (CAPM) introduced by Sharpe (1964) that is an essential element of assessing the value of diverse assets. The non-parametric methods used in this research are the robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator). The Jackknife, the resampling technique, is also employed to validate the results. According to finance literature and common practices, these coecients have often been estimated using Ordinary Least Square (LS) regression method and monthly return data set. The empirical results of this research pointed out that the robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator) performed much better than Ordinary Least Square (LS) in terms of eciency for large-cap stocks trading actively in the United States markets. Interestingly, the empirical results also showed that daily return data would give more accurate estimation than monthly return data in both Ordinary Least Square (LS) and robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator) regressions.

Algorithm for the Robust Estimation in Logistic Regression (로지스틱회귀모형의 로버스트 추정을 위한 알고리즘)

  • Kim, Bu-Yong;Kahng, Myung-Wook;Choi, Mi-Ae
    • The Korean Journal of Applied Statistics
    • /
    • v.20 no.3
    • /
    • pp.551-559
    • /
    • 2007
  • The maximum likelihood estimation is not robust against outliers in the logistic regression. Thus we propose an algorithm for the robust estimation, which identifies the bad leverage points and vertical outliers by the V-mask type criterion, and then strives to dampen the effect of outliers. Our main finding is that, by an appropriate selection of weights and factors, we could obtain the logistic estimates with high breakdown point. The proposed algorithm is evaluated by means of the correct classification rate on the basis of real-life and artificial data sets. The results indicate that the proposed algorithm is superior to the maximum likelihood estimation in terms of the classification.

Mechanical Parameter Identification of Servo Systems using Robust Support Vector Regression (Support Vector Regression을 이용한 서보 시스템의 기계적 상수 추정)

  • Cho Kyung-Rae;Seok Jul-Ki
    • The Transactions of the Korean Institute of Power Electronics
    • /
    • v.10 no.5
    • /
    • pp.468-480
    • /
    • 2005
  • The overall performance of AC servo system is greatly affected the uncertainties of unpredictable mechanical parameter variations and external load disturbances. To overcome this problem, it is necessary to know different parameters and load disturbances subjected to position/speed control. This paper proposes an on-line identification method of mechanical parameters/load disturbances for AC servo system using support vector regression(SVR). The experimental results demonstrate that the proposed SVR algorithm is appropriate for control of unknown servo systems even with time-varying/nonlinear parameters.

On robustness in dimension determination in fused sliced inverse regression

  • Yoo, Jae Keun;Cho, Yoo Na
    • Communications for Statistical Applications and Methods
    • /
    • v.25 no.5
    • /
    • pp.513-521
    • /
    • 2018
  • The goal of sufficient dimension reduction (SDR) is to replace original p-dimensional predictors with a lower-dimensional linearly transformed predictor. The sliced inverse regression (SIR) (Li, Journal of the American Statistical Association, 86, 316-342, 1991) is one of the most popular SDR methods because of its applicability and simple implementation in practice. However, SIR may yield different dimension reduction results for different numbers of slices and despite its popularity, is a clear deficit for SIR. To overcome this, a fused sliced inverse regression was recently proposed. The study shows that the dimension-reduced predictors is robust to the numbers of the slices, but it does not investigate how robust its dimension determination is. This paper suggests a permutation dimension determination for the fused sliced inverse regression that is compared with SIR to investigate the robustness to the numbers of slices in the dimension determination. Numerical studies confirm this and a real data example is presented.

A Local Influence Approach to Regression Diagnostics with Application to Robust Regression

  • Huh, Myung-Hoe;Park, Sung H.
    • Journal of the Korean Statistical Society
    • /
    • v.19 no.2
    • /
    • pp.151-159
    • /
    • 1990
  • Regression diagnostics often involves assesment of the changes that result from deleting multiple cases. Diagnostic mehtodology based on global influence measure, however, needs prohibitive computing time. As an alternative, Cook (1986) developed influence approach in which it is checked whether a minor modification of specifiation influences key results of an analysis. In line with Cook's development, we propose and study an inflence derivative method that yields both the magnitude and direction of case influences. The utility of our methodology is highlighted when case influence derivatives are plotted in a lower demensional space. Such plots are especially effective in unmasking "masked" observations in least squares regression and in robust regression also. We give several illustrations.strations.

  • PDF

On a Robust Test for Parallelism of Regression Lines against Ordered Alternatives

  • Song, Moon-Sup;Kim, Jin-Ho
    • Communications for Statistical Applications and Methods
    • /
    • v.4 no.2
    • /
    • pp.565-579
    • /
    • 1997
  • A robust test is proposed for the problem of testing the parallelism of several regression lines against ordered alternatives. The proposed test statistic is based on a linear combination of one-step pairwise GM-estimators. We compare the performance of the proposed test with that of the other tests through a Monte Carlo simulation. The results of the simulation study show that the proposed test has stable levels, good empirical powers in various circumstances, and particularly higher empirical powers under the presence of extreme outliers or leverage points.

  • PDF

Empirical Choice of the Shape Parameter for Robust Support Vector Machines

  • Pak, Ro-Jin
    • Communications for Statistical Applications and Methods
    • /
    • v.15 no.4
    • /
    • pp.543-549
    • /
    • 2008
  • Inspired by using a robust loss function in the support vector machine regression to control training error and the idea of robust template matching with M-estimator, Chen (2004) applies M-estimator techniques to gaussian radial basis functions and form a new class of robust kernels for the support vector machines. We are specially interested in the shape of the Huber's M-estimator in this context and propose a way to find the shape parameter of the Huber's M-estimating function. For simplicity, only the two-class classification problem is considered.

A MEASURE OF ROBUST ROTATABILITY FOR SECOND ORDER RESPONSE SURFACE DESIGNS

  • Das, Rabindra Nath;Park, Sung-Hyun
    • Journal of the Korean Statistical Society
    • /
    • v.36 no.4
    • /
    • pp.557-578
    • /
    • 2007
  • In Response Surface Methodology (RSM), rotatability is a natural and highly desirable property. For second order general correlated regression model, the concept of robust rotatability was introduced by Das (1997). In this paper a new measure of robust rotatability for second order response surface designs with correlated errors is developed and illustrated with an example. A comparison is made between the newly developed measure with the previously suggested measure by Das (1999).