• Title/Summary/Keyword: least squares problem

Search Result 347, Processing Time 0.025 seconds

A Hybrid Algorithm for Identifying Multiple Outlers in Linear Regression

  • Kim, Bu-yong;Kim, Hee-young
    • Communications for Statistical Applications and Methods
    • /
    • v.9 no.1
    • /
    • pp.291-304
    • /
    • 2002
  • This article is concerned with an effective algorithm for the identification of multiple outliers in linear regression. It proposes a hybrid algorithm which employs the least median of squares estimator, instead of the least squares estimator, to construct an Initial clean subset in the stepwise forward search scheme. The performance of the proposed algorithm is evaluated and compared with the existing competitor via an extensive Monte Carlo simulation. The algorithm appears to be superior to the competitor for the most of scenarios explored in the simulation study. Particularly it copes with the masking problem quite well. In addition, the orthogonal decomposition and Its updating techniques are considered to improve the computational efficiency and numerical stability of the algorithm.

A Study for the Roundness Estimation (진원도 형상 추정 연구)

  • Kim, Soo-Kwang;Jun, Jae-Uhk
    • Journal of the Korean Society of Manufacturing Process Engineers
    • /
    • v.10 no.2
    • /
    • pp.38-45
    • /
    • 2011
  • The criteria for determining the elements are the minimum zone method(MZM) and the least squares method(LSM). The LSM is deterministic and simple but is limited at the measurements whose errors are significant compared with form errors. For the precise condition, minimum zone method(MZM) has been selected to determine the elements. The roundness is the fundamental problem in the evaluating form errors. In this paper, anew approach adapting the genius education concept is proposed to obtain an accurate results for the MZM and the LSM of the roundness. Its computational algorithm is studied on a set of measured sample data. To be of almost no account of the specification(the number and the standard deviation etc.) of the sanple data, the results shoqs excellent reliability and high accuracy in estimating the roundness.

Performance Analysis of Quaternion-based Least-squares Methods for GPS Attitude Estimation (GPS 자세각 추정을 위한 쿼터니언 기반 최소자승기법의 성능평가)

  • Won, Jong-Hoon;Kim, Hyung-Cheol;Ko, Sun-Jun;Lee, Ja-Sung
    • Proceedings of the KIEE Conference
    • /
    • 2001.07d
    • /
    • pp.2092-2095
    • /
    • 2001
  • In this paper, the performance of a new alternative form of three-axis attitude estimation algorithm for a rigid body is evaluated via simulation for the situation where the observed vectors are the estimated baselines of a GPS antenna array. This method is derived based on a simple iterative nonlinear least-squares with four elements of quaternion parameter. The representation of quaternion parameters for three-axis attitude of a rigid body is free from singularity problem. The performance of the proposed algorithm is compared with other eight existing methods, such as, Transformation Method (TM), Vector Observation Method (VOM), TRIAD algorithm, two versions of QUaternion ESTimator (QUEST), Singular Value Decomposition (SVD) method, Fast Optimal Attitude Matrix (FOAM), Slower Optimal Matrix Algorithm (SOMA).

  • PDF

Estimation of error variance in nonparametric regression under a finite sample using ridge regression

  • Park, Chun-Gun
    • Journal of the Korean Data and Information Science Society
    • /
    • v.22 no.6
    • /
    • pp.1223-1232
    • /
    • 2011
  • Tong and Wang's estimator (2005) is a new approach to estimate the error variance using least squares method such that a simple linear regression is asymptotically derived from Rice's lag- estimator (1984). Their estimator highly depends on the setting of a regressor and weights in small sample sizes. In this article, we propose a new approach via a local quadratic approximation to set regressors in a small sample case. We estimate the error variance as the intercept using a ridge regression because the regressors have the problem of multicollinearity. From the small simulation study, the performance of our approach with some existing methods is better in small sample cases and comparable in large cases. More research is required on unequally spaced points.

Sparse Kernel Regression using IRWLS Procedure

  • Park, Hye-Jung
    • Journal of the Korean Data and Information Science Society
    • /
    • v.18 no.3
    • /
    • pp.735-744
    • /
    • 2007
  • Support vector machine(SVM) is capable of providing a more complete description of the linear and nonlinear relationships among random variables. In this paper we propose a sparse kernel regression(SKR) to overcome a weak point of SVM, which is, the steep growth of the number of support vectors with increasing the number of training data. The iterative reweighted least squares(IRWLS) procedure is used to solve the optimal problem of SKR with a Laplacian prior. Furthermore, the generalized cross validation(GCV) function is introduced to select the hyper-parameters which affect the performance of SKR. Experimental results are then presented which illustrate the performance of the proposed procedure.

  • PDF

Support Vector Quantile Regression with Weighted Quadratic Loss Function

  • Shim, Joo-Yong;Hwang, Chang-Ha
    • Communications for Statistical Applications and Methods
    • /
    • v.17 no.2
    • /
    • pp.183-191
    • /
    • 2010
  • Support vector quantile regression(SVQR) is capable of providing more complete description of the linear and nonlinear relationships among random variables. In this paper we propose an iterative reweighted least squares(IRWLS) procedure to solve the problem of SVQR with a weighted quadratic loss function. Furthermore, we introduce the generalized approximate cross validation function to select the hyperparameters which affect the performance of SVQR. Experimental results are then presented which illustrate the performance of the IRWLS procedure for SVQR.

Generalized Bayes estimation for a SAR model with linear restrictions binding the coefficients

  • Chaturvedi, Anoop;Mishra, Sandeep
    • Communications for Statistical Applications and Methods
    • /
    • v.28 no.4
    • /
    • pp.315-327
    • /
    • 2021
  • The Spatial Autoregressive (SAR) models have drawn considerable attention in recent econometrics literature because of their capability to model the spatial spill overs in a feasible way. While considering the Bayesian analysis of these models, one may face the problem of lack of robustness with respect to underlying prior assumptions. The generalized Bayes estimators provide a viable alternative to incorporate prior belief and are more robust with respect to underlying prior assumptions. The present paper considers the SAR model with a set of linear restrictions binding the regression coefficients and derives restricted generalized Bayes estimator for the coefficients vector. The minimaxity of the restricted generalized Bayes estimator has been established. Using a simulation study, it has been demonstrated that the estimator dominates the restricted least squares as well as restricted Stein rule estimators.

Blind signal separation for coprime planar arrays: An improved coupled trilinear decomposition method

  • Zhongyuan Que;Xiaofei Zhang;Benzhou Jin
    • ETRI Journal
    • /
    • v.45 no.1
    • /
    • pp.138-149
    • /
    • 2023
  • In this study, the problem of blind signal separation for coprime planar arrays is investigated. For coprime planar arrays comprising two uniform rectangular subarrays, we link the signal separation to the tensor-based model called coupled canonical polyadic decomposition (CPD) and propose an improved coupled trilinear decomposition approach. The output data of coprime planar arrays are modeled as a coupled tensor set that can be further interpreted as a coupled CPD model, allowing a signal separation to be achieved using coupled trilinear alternating least squares (TALS). Furthermore, in the procedure of the coupled TALS, a Vandermonde structure enforcing approach is explicitly applied, which is shown to ensure fast convergence. The results of Monto Carlo simulations show that our proposed algorithm has the same separation accuracy as the basic coupled TALS but with a faster convergence speed.

SUBSTRUCTURING ALGORITHM FOR STRUCTURAL OPTIMIZATION USING THE FORCE METHOD

  • JANG, HO-JONG
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • v.2 no.2
    • /
    • pp.41-47
    • /
    • 1998
  • We consider some numerical solution methods for equality-constrained quadratic problems in the context of structural analysis. Sparse orthogonal schemes for linear least squares problem are adapted to handle the solution step of the force method. We also examine these schemes with substructuring concepts.

  • PDF

ON DIFFERENTIABILITY OF THE MATRIX TRACE OPERATOR AND ITS APPLICATIONS

  • Dulov, E.V.;Andrianova, N.A.
    • Journal of applied mathematics & informatics
    • /
    • v.8 no.1
    • /
    • pp.97-109
    • /
    • 2001
  • This article is devoted to “forgotten” and rarely used technique of matrix analysis, introduced in 60-70th and enhanced by authors. We will study the matrix trace operator and it’s differentiability. This idea generalizes the notion of scalar derivative for matrix computations. The list of the most common derivatives is given at the end of the article. Additionally we point out a close connection of this technique with a least square problem in it’s classical and generalized case.