• Title/Summary/Keyword: Ordinary Least Squares regression

Search Result 108, Processing Time 0.026 seconds

DETECTION OF OUTLIERS IN WEIGHTED LEAST SQUARES REGRESSION

  • Shon, Bang-Yong;Kim, Guk-Boh
    • Journal of applied mathematics & informatics
    • /
    • v.4 no.2
    • /
    • pp.501-512
    • /
    • 1997
  • In multiple linear regression model we have presupposed assumptions (independence normality variance homogeneity and so on) on error term. When case weights are given because of variance heterogeneity we can estimate efficiently regression parameter using weighted least squares estimator. Unfortunately this estimator is sen-sitive to outliers like ordinary least squares estimator. Thus in this paper we proposed some statistics for detection of outliers in weighted least squares regression.

Unified Non-iterative Algorithm for Principal Component Regression, Partial Least Squares and Ordinary Least Squares

  • Kim, Jong-Duk
    • Journal of the Korean Data and Information Science Society
    • /
    • v.14 no.2
    • /
    • pp.355-366
    • /
    • 2003
  • A unified procedure for principal component regression (PCR), partial least squares (PLS) and ordinary least squares (OLS) is proposed. The process gives solutions for PCR, PLS and OLS in a unified and non-iterative way. This enables us to see the interrelationships among the three regression coefficient vectors, and it is seen that the so-called E-matrix in the solution expression plays the key role in differentiating the methods. In addition to setting out the procedure, the paper also supplies a robust numerical algorithm for its implementation, which is used to show how the procedure performs on a real world data set.

  • PDF

Various Models of Fuzzy Least-Squares Linear Regression for Load Forecasting (전력수요예측을 위한 다양한 퍼지 최소자승 선형회귀 모델)

  • Song, Kyung-Bin
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.21 no.7
    • /
    • pp.61-67
    • /
    • 2007
  • The load forecasting has been an important part of power system Accordingly, it has been proposed various methods for the load forecasting. The load patterns of the special days is quite different than those of ordinary weekdays. It is difficult to accurately forecast the load of special days due to the insufficiency of the load patterns compared with ordinary weekdays, so we have proposed fuzzy least squares linear regression algorithm for the load forecasting. In this paper we proposed four models for fuzzy least squares linear regression. It is separated by coefficients of fuzzy least squares linear regression equation. we compared model of H1 with H4 and prove it H4 has accurately forecast better than H1.

Expressions for Shrinkage Factors of PLS Estimator

  • Kim, Jong-Duk
    • Journal of the Korean Data and Information Science Society
    • /
    • v.17 no.4
    • /
    • pp.1169-1180
    • /
    • 2006
  • Partial least squares regression (PLS) is a biased, non-least squares regression method and is an alternative to the ordinary least squares regression (OLS) when predictors are highly collinear or predictors outnumber observations. One way to understand the properties of biased regression methods is to know how the estimators shrink the OLS estimator. In this paper, we introduce an expression for the shrinkage factor of PLS and develop a new shrinkage expression, and then prove the equivalence of the two representations. We use two near-infrared (NIR) data sets to show general behavior of the shrinkage and in particular for what eigendirections PLS expands the OLS coefficients.

  • PDF

Two-step LS-SVR for censored regression

  • Bae, Jong-Sig;Hwang, Chang-Ha;Shim, Joo-Yong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.23 no.2
    • /
    • pp.393-401
    • /
    • 2012
  • This paper deals with the estimations of the least squares support vector regression when the responses are subject to randomly right censoring. The estimation is performed via two steps - the ordinary least squares support vector regression and the least squares support vector regression with censored data. We use the empirical fact that the estimated regression functions subject to randomly right censoring are close to the true regression functions than the observed failure times subject to randomly right censoring. The hyper-parameters of model which affect the performance of the proposed procedure are selected by a generalized cross validation function. Experimental results are then presented which indicate the performance of the proposed procedure.

Preference Map using Weighted Regression

  • S.Y. Hwang;Jung, Su-Jin;Kim, Young-Won
    • Communications for Statistical Applications and Methods
    • /
    • v.8 no.3
    • /
    • pp.651-659
    • /
    • 2001
  • Preference map is a widely used graphical method for the preference data set which is frequently encountered in the field of marketing research. This provides joint configuration usually in two dimensional space between "products" and their "attributes". Whereas the classical preference map adopts the ordinary least squares method in deriving map, the present article suggests the weighted least squares approach providing the better graphical display and interpretation compared to the classical one. Internet search engine data in Korea are analysed for illustration.

  • PDF

Consistency and Bounds on the Bias of $S^2$ in the Linear Regression Model with Moving Average Disturbances

  • Song, Seuck-Heun
    • Journal of the Korean Statistical Society
    • /
    • v.24 no.2
    • /
    • pp.507-518
    • /
    • 1995
  • The ordinary least squares based estiamte $S^2$ of the disturbance variance is considered in the linear regression model when the disturbances follow the first-order moving-average process. It is shown that $S^2$ is weakly consistent estimate for the disturbance varaince without any restriction on the regressor matrix X. Also, simple exact bounds on the relative bias of $S^2$ are given in finite sample sizes.

  • PDF

Reflections on the China-Malaysia Economic Partnership

  • AL SHAHER, Shaher;ZREIK, Mohamad
    • The Journal of Asian Finance, Economics and Business
    • /
    • v.9 no.3
    • /
    • pp.229-234
    • /
    • 2022
  • The study aims to investigate whether Musharakah management has an impact on Chinese and Malaysian business partnerships. To estimate the relationship between Musharakah and the Sino-Malaysian partnership, this study uses a panel econometric technique namely pooled ordinary least squares. Ordinary Least Squares regression (OLS) is a common technique for estimating coefficients of linear regression equations which describe the relationship between one or more independent quantitative variables and a dependent variable. Data was retrieved from the annual reports (from 2009 to 2019) of non-financial firms listed on the stock exchange of China and Malaysia. Four partnership measures (i.e., Musharakah, Mudarabah, Tawuruq, and Kafalah) were used to estimate the impact of Musharakah on the Sino-Malaysian partnership. Empirical results reveal that Musharakah and Mudarabah are positively related to Kafalah but the relationship is statistically insignificant. Alternatively, Musharakah is positively and significantly related to Mudarabah. Musharakah and Mudarabah have a positive but insignificant relationship. The findings of this study suggest that management of partnership has a positive impact on firm partnership. Furthermore, it supports the hypothesis that improving partnership enhances Musharakah, which has a positive impact on the firm's partnership.

Pitfalls in the Application of the COTE in a Linear Regression Model with Seasonal Data

  • Seuck Heun Song;YouSung Park
    • Communications for Statistical Applications and Methods
    • /
    • v.4 no.2
    • /
    • pp.353-358
    • /
    • 1997
  • When the disturbances in the linear repression medel are generated by a seasonal autoregressive scheme the Cochrane Orcutt transformation estimator (COTE) is a well known alternative to Generalized Least Squares estimator (GLSE). In this paper it is analyzed in which situation the Ordinary Least Squares estimator (OLSE) is always better than COTE for positive autocorrelation in terms of efficiency which is here defined as the ratio of the total variances.

  • PDF

A Study on the Improvement of the Accuracy for the Least-Squares Method Using Orthogonal Function (직교함수를 이용한 최소자승법의 정밀도 향상에 관한 연구)

  • Cho, Won Cheol;Lee, Jae Joon
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.6 no.4
    • /
    • pp.43-52
    • /
    • 1986
  • With increasing of computer use, a least squares method is now widely used in the regression analysis of various data. Unreliable results of regression coefficients due to the floating point of computer and problems of ordinary least squares method are described in detail. To improve these problems, a least squares method using orthogonal function is developed. Also, Comparison and analysis are performed through an example of numerical test, and re-orthogonalization method is used to increase the accuracy. As an example of application, the optimum order of AR process for the time series of monthly flow at the Pyungchang station is determined using Akaike's FPE(Final Prediction Error) which decides optimum degree of AR process. The result shows the AR(2) process is optimum to the series at the station.

  • PDF