Browse > Article
http://dx.doi.org/10.5351/KJAS.2007.20.1.195

Graphical Method for Multiple Regression Model  

Lee, W.R. (Department of Applied Statistics, Kyonggi University)
Lee, U.K. (Research Institute of Applied Statistics, Sungkyunkwan University)
Hong, C.S. (Department of Statistics, Sungkyunkwan University)
Publication Information
The Korean Journal of Applied Statistics / v.20, no.1, 2007 , pp. 195-204 More about this Journal
Abstract
In order to represent multiple regression data, an alternative graphical method, called as SSR Plot, is proposed by using geometrical description methods. This plot uses the relation that the sum of sqaures for regression (SSR) of two explanatory variables is known as the sum of the SSR of one variable and the increase in the SSR due to the addition of other variable to the model that already contains a variable. This half circle shaped SSR plot contains vectors corresponding explanatory variables. We might conclude that some explanatory variables corresponding to vectors which locate near the horisontal axis do affect the response variable. Also, for the regression model with two explanatory variables, a magnitude of the angle between two vectors can be identified for suppression.
Keywords
Coefficient of determination; correlation; geometry; SSR; suppression;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Margolis, M. S. (1979). Perpendicular projections and elementary statistics, The American Statistician, 33, 131-135   DOI
2 Schey, H. M. (1993). The relationship between the magnitudes of SSR($x_2$) and SSR($x_2|x_1$): a geometric description, The American Statistician, 47, 26-30   DOI
3 Sharpe, N. R. and Roberts, R. A. (1997). The relationship among sums of squares, correlation coefficients, and suppression, The American Statistician, 51, 46-48   DOI
4 Velicer, W. F. (1978). Suppressor variables and the semipartial correlation coefficient, Educational and Psychological Measurement, 38, 953-958   DOI
5 Rawlings, J. O., Pantula, S. G. and Dickey, D. A. (1998). Applied Regression Analysis: A Research Tool, 2nd. ed, Springer-Verlag, New York
6 Trosset. M. W. (2005). Visualizing correlation, Journal of Computational & Gmphical Statistics, 14, 1-19   DOI   ScienceOn
7 Corsten, L. C. A. and Gabriel, K. R. (1976). Graphical exploration in comparing variance matrices, Biometrics, 32, 851-863   DOI   ScienceOn
8 Draper, N. and Smith, H. (1981). Applied Regression Analysis, 2nd ed., John Wiley & Sons, New York
9 Freund, R. J. (1988). When is $R^2>r^2_{yx1}+r^2_{yx2}$(Revisited), The American Statistician, 42, 89-90
10 Friedman, L. and Wall, M. (2005). Graphical views of suppression and multicollinearity in multiple linear regression, The American Statistician, 59, 127-136   DOI   ScienceOn
11 Gabriel, K. R. (1971). The biplot graphical display of matrices with applications to principal component analysis, Biometrika, 58, 453-467   DOI   ScienceOn
12 Gay, D. M. (1983). Algorithm 611: subroutines for unconstrained minimization using a model/trust-region approach, ACM Transactions on Mathematical Software, 9, 503-524   DOI   ScienceOn
13 Gay, D. M. (1984). A trust region approach to linearly constrained optimization, In Numerical Analysis, Proceedings, Dundee 1983, (F. A. Lootsma ed.), Springer, Berlin, 171-189
14 Hamilton, D. (1987). Sometimes $R^2>r^2_{yx1}+r^2_{yx2}$ correlated variables are not always redundant, The American Statistician, 41, 129-132   DOI
15 Hamilton, D. C. (1988). Reply to Freund and Mitra, The American Statistician, 42, 90-91
16 Herr, D. G. (1980). On the history of the use of geometry in the general linear model, The American Statistician, 34, 43-47   DOI
17 Horst, P. (1941). The role of prediction variables which are independent of the criterion, The Prediction of Personal Adjustment, (P. Horst ed.), Social Science Research Council, New York, 431-436
18 Mitra, S. (1988). The relationship between the multiple and the zero-order correlation coefficients, The American Statistician, 42, 89
19 Bryant, P. (1984). Geometry, statistics, probability: variations on a common theme, The American Statistician, 38, 38-48   DOI
20 Box, G. E. P., Hunter, W. G. and Hunter, J. S. (1978). Statistics for Experimenters: An Introduction to Design, Data Analysis and Model Building, John Wiley & Sons, New York
21 Chatterjee, S., Hadi, A. S. and Price, B. (2000). Regression Analysis by Example, 3rd ed., John Wiley & Sons, New York
22 Christensen, R. (2006). Comment and reply to Friedman and Wall (2005), The American Statistician, 60, 101-102   DOI
23 Cohen, J. and Cohen, P. (1975). Applied Multiple Regression/Correlation Analysis for the Behavioml Sciences, Lawrence Erlbaum Associates, New Jersey
24 Conger, A. J. (1974). A revised definition for suppressor variables: a guide to their identification and interpretation, Educational and Psychological Measurement, 34, 35-46   DOI