• Title/Summary/Keyword: weighted least squares regression

Search Result 44, Processing Time 0.028 seconds

Hybrid Fuzzy Least Squares Support Vector Machine Regression for Crisp Input and Fuzzy Output

  • Shim, Joo-Yong;Seok, Kyung-Ha;Hwang, Chang-Ha
    • Communications for Statistical Applications and Methods
    • /
    • v.17 no.2
    • /
    • pp.141-151
    • /
    • 2010
  • Hybrid fuzzy regression analysis is used for integrating randomness and fuzziness into a regression model. Least squares support vector machine(LS-SVM) has been very successful in pattern recognition and function estimation problems for crisp data. This paper proposes a new method to evaluate hybrid fuzzy linear and nonlinear regression models with crisp inputs and fuzzy output using weighted fuzzy arithmetic(WFA) and LS-SVM. LS-SVM allows us to perform fuzzy nonlinear regression analysis by constructing a fuzzy linear regression function in a high dimensional feature space. The proposed method is not computationally expensive since its solution is obtained from a simple linear equation system. In particular, this method is a very attractive approach to modeling nonlinear data, and is nonparametric method in the sense that we do not have to assume the underlying model function for fuzzy nonlinear regression model with crisp inputs and fuzzy output. Experimental results are then presented which indicate the performance of this method.

Terrain Slope Estimation Methods Using the Least Squares Approach for Terrain Referenced Navigation

  • Mok, Sung-Hoon;Bang, Hyochoong
    • International Journal of Aeronautical and Space Sciences
    • /
    • v.14 no.1
    • /
    • pp.85-90
    • /
    • 2013
  • This paper presents a study on terrain referenced navigation (TRN). The extended Kalman filter (EKF) is adopted as a filter method. A Jacobian matrix of measurement equations in the EKF consists of terrain slope terms, and accurate slope estimation is essential to keep filter stability. Two slope estimation methods are proposed in this study. Both methods are based on the least-squares approach. One is planar regression searching the best plane, in the least-squares sense, representing the terrain map over the region, determined by position error covariance. It is shown that the method could provide a more accurate solution than the previously developed linear regression approach, which uses lines rather than a plane in the least-squares measure. The other proposed method is weighted planar regression. Additional weights formed by Gaussian pdf are multiplied in the planar regression, to reflect the actual pdf of the position estimate of EKF. Monte Carlo simulations are conducted, to compare the performance between the previous and two proposed methods, by analyzing the filter properties of divergence probability and convergence speed. It is expected that one of the slope estimation methods could be implemented, after determining which of the filter properties is more significant at each mission.

Robust Singular Value Decomposition BaLsed on Weighted Least Absolute Deviation Regression

  • Jung, Kang-Mo
    • Communications for Statistical Applications and Methods
    • /
    • v.17 no.6
    • /
    • pp.803-810
    • /
    • 2010
  • The singular value decomposition of a rectangular matrix is a basic tool to understand the structure of the data and particularly the relationship between row and column factors. However, conventional singular value decomposition used the least squares method and is not robust to outliers. We propose a simple robust singular value decomposition algorithm based on the weighted least absolute deviation which is not sensitive to leverage points. Its implementation is easy and the computation time is reasonably low. Numerical results give the data structure and the outlying information.

Estimation of Regionai Skew Coefficient with Weighted Least Squares Regression (가중회귀분석에 의한 지역화왜곡계수의 추정)

  • 조국광;권순국
    • Magazine of the Korean Society of Agricultural Engineers
    • /
    • v.32 no.1
    • /
    • pp.103-109
    • /
    • 1990
  • The application of the Log-Pearson Type m distribution recommended by Water Resources Council, U. S. A. for flood frequency analysis requires the estimation of the regionalized skew coefficient. In this study, regionalized skew coefficients are estimated using a weighted regression model which relates at-site skews based on logarithms of observed annual flood peak series to both basin characteristics and precipitation data in the Han river and the Nakdong river basin. The model is developed with weighted least squares method in which the weights are determined by separating residual variance into that due to model error and due to sampling error. As the result of analysis, regionalized skews are estimated as - 0.732 and - 0.575 in the Han river and the Nakdong river basin, respectively.

  • PDF

Comparison of linear and non-linear equation for the calibration of roxithromycin analysis using liquid chromatography/mass spectrometry

  • Lim, Jong-Hwan;Yun, Hyo-In
    • Korean Journal of Veterinary Research
    • /
    • v.50 no.1
    • /
    • pp.11-17
    • /
    • 2010
  • Linear and non-linear regressions were used to derive the calibration function for the measurement of roxithromycin plasma concentration. Their results were compared with weighted least squares regression by usual weight factors. In this paper the performance of a non-linear calibration equation with the capacity to account empirically for the curvature, y = ax$^{b}$ + c (b $\neq$ 1) is compared with the commonly used linear equation, y = ax + b, as well as the quadratic equation, y = ax$^{2}$+ bx + c. In the calibration curve (range of 0.01 to 10 ${\mu}g/mL$) of roxithromycin, both heteroscedasticity and nonlinearity were present therefore linear least squares regression methods could result in large errors in the determination of roxithromycin concentration. By the non-linear and weighted least squares regression, the accuracy of the analytical method was improved at the lower end of the calibration curve. This study suggests that the non-linear calibration equation should be considered when a curve is required to be fitted to low dose calibration data which exhibit slight curvature.

On a Robust Subset Selection Procedure for the Slopes of Regression Equations

  • Song, Moon-Sup;Oh, Chang-Hyuck
    • Journal of the Korean Statistical Society
    • /
    • v.10
    • /
    • pp.105-121
    • /
    • 1981
  • The problem of selection of a subset containing the largest of several slope parameters of regression equations is considered. The proposed selection procedure is based on the weighted median estimators for regression parameters and the median of rescaled absolute residuals for scale parameters. Those estimators are compared with the classical least squares estimators by a simulation study. A Monte Carlo comparison is also made between the new procedure based on the weighted median estiamtors and the procedure based on the least squares estimators. The results show that the proposed procedure is quite robust with respect to the heaviness of distribution tails.

  • PDF

Robust varying coefficient model using L1 regularization

  • Hwang, Changha;Bae, Jongsik;Shim, Jooyong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.27 no.4
    • /
    • pp.1059-1066
    • /
    • 2016
  • In this paper we propose a robust version of varying coefficient models, which is based on the regularized regression with L1 regularization. We use the iteratively reweighted least squares procedure to solve L1 regularized objective function of varying coefficient model in locally weighted regression form. It provides the efficient computation of coefficient function estimates and the variable selection for given value of smoothing variable. We present the generalized cross validation function and Akaike information type criterion for the model selection. Applications of the proposed model are illustrated through the artificial examples and the real example of predicting the effect of the input variables and the smoothing variable on the output.

Support Vector Quantile Regression with Weighted Quadratic Loss Function

  • Shim, Joo-Yong;Hwang, Chang-Ha
    • Communications for Statistical Applications and Methods
    • /
    • v.17 no.2
    • /
    • pp.183-191
    • /
    • 2010
  • Support vector quantile regression(SVQR) is capable of providing more complete description of the linear and nonlinear relationships among random variables. In this paper we propose an iterative reweighted least squares(IRWLS) procedure to solve the problem of SVQR with a weighted quadratic loss function. Furthermore, we introduce the generalized approximate cross validation function to select the hyperparameters which affect the performance of SVQR. Experimental results are then presented which illustrate the performance of the IRWLS procedure for SVQR.

Weighted LS-SVM Regression for Right Censored Data

  • Kim, Dae-Hak;Jeong, Hyeong-Chul
    • Communications for Statistical Applications and Methods
    • /
    • v.13 no.3
    • /
    • pp.765-776
    • /
    • 2006
  • In this paper we propose an estimation method on the regression model with randomly censored observations of the training data set. The weighted least squares support vector machine regression is applied for the regression function estimation by incorporating the weights assessed upon each observation in the optimization problem. Numerical examples are given to show the performance of the proposed estimation method.