• Communications for Statistical Applications and Methods
• /
• v.13 no.2
• /
• pp.233-241
• /
• 2006

Classical principal component analysis (PCA) can be formulated as finding the linear subspace that best accommodates multidimensional data points in the sense that the sum of squared residual distances is minimized. As alternatives to such LS (least squares) fitting approach, we produce LMS (least median of squares) and LTS (least trimmed squares)-type PCA by minimizing the median of squared residual distances and the trimmed sum of squares, in a similar fashion to Rousseeuw (1984)'s alternative approaches to LS linear regression. Proposed methods adopt the data-driven optimization algorithm of Croux and Ruiz-Gazen (1996, 2005) that is conceptually simple and computationally practical. Numerical examples are given.

• Communications for Statistical Applications and Methods
• /
• v.14 no.1
• /
• pp.183-193
• /
• 2007

This paper shows that a response function for the center of fuzzy output nay not be the same as that for the spread in a fuzzy linear regression model and then suggests a separate fuzzy regression model makes a distinction between response functions of the center and the spread of fuzzy output. Also we use a least squares method to estimate the separate fuzzy regression model and compare an accuracy of proposed model with another fuzzy regression model developed by Diamond (1988) and Kao and Chyu (2003).

• Journal of the Korean Institute of Intelligent Systems
• /
• v.13 no.5
• /
• pp.571-575
• /
• 2003

In this paper, we describe a method for fuzzy polynomial regression analysis for fuzzy input--output data using shape preserving operations for least-squares fitting. Shape preserving operations simplifies the computation of fuzzy arithmetic operations. We derive the solution using mixed nonlinear program.

• Journal of the Korean Data and Information Science Society
• /
• v.14 no.2
• /
• pp.337-343
• /
• 2003

In this paper we present the prediction interval estimation method using bootstrap method for least squares support vector machine(LS-SVM) regression, which allows us to perform even nonlinear regression by constructing a linear regression function in a high dimensional feature space. The bootstrap method is applied to generate the bootstrap sample for estimation of the covariance of the regression parameters consisting of the optimal bias and Lagrange multipliers. Experimental results are then presented which indicate the performance of this algorithm.

• Journal of the Korean Data and Information Science Society
• /
• v.27 no.2
• /
• pp.523-530
• /
• 2016

Most classical control charts assume that processes are serially independent, and autocorrelation among variables makes them unreliable. To address this issue, a variety of statistical approaches has been employed to estimate the serial structure of the process. In this paper, we propose a multioutput least squares support vector regression and apply it to construct a residual multivariate cumulative sum control chart for detecting changes in the process mean vector. Numerical studies demonstrate that the proposed multioutput least squares support vector regression based control chart provides more satisfying results in detecting small shifts in the process mean vector.

• Journal of the Korean Data and Information Science Society
• /
• v.28 no.1
• /
• pp.227-235
• /
• 2017

When the spatial information of each location is given specifically as coordinates it is popular to use the geographically weighted regression to incorporate the spatial information by assuming that the regression parameters vary spatially across locations. In this paper, we relax the linearity assumption of geographically weighted regression and propose a geographically weighted least squares-support vector machine for estimating geographically weighted mean by using the basic concept of kernel machines. Generalized cross validation function is induced for the model selection. Numerical studies with real datasets have been conducted to compare the performance of proposed method with other methods for predicting geographically weighted mean.

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.52 no.4
• /
• pp.233-237
• /
• 2003

An accurate load forecasting is essential for economics and stability power system operation. Due to high relationship between the electric power load and the electric power price, the participants of the competitive power market are very interested in load forecasting. The percentage errors of load forecasting for holidays is relatively large. In order to improve the accuarcy of load forecasting for holidays, this paper proposed load forecasting method for holidays using a fuzzy least squares linear regression algorithm. The proposed algorithm is tested for load forecasting for holidays in 1996, 1997, and 2000. The test results show that the proposed algorithm is better than the algorithm using fuzzy linear regression.

• Journal of applied mathematics & informatics
• /
• v.27 no.3_4
• /
• pp.903-908
• /
• 2009

The shrink parameter in ridge regression may be contaminated by outlying points. We propose robust cross validation scores in ridge regression instead of classical cross validation. We use robust location estimators such as median, least trimmed squares, absolute mean for robust cross validation scores. The robust scores have global robustness. Simulations are performed to show the effectiveness of the proposed estimators.

• Communications for Statistical Applications and Methods
• /
• v.17 no.2
• /
• pp.141-151
• /
• 2010

Hybrid fuzzy regression analysis is used for integrating randomness and fuzziness into a regression model. Least squares support vector machine(LS-SVM) has been very successful in pattern recognition and function estimation problems for crisp data. This paper proposes a new method to evaluate hybrid fuzzy linear and nonlinear regression models with crisp inputs and fuzzy output using weighted fuzzy arithmetic(WFA) and LS-SVM. LS-SVM allows us to perform fuzzy nonlinear regression analysis by constructing a fuzzy linear regression function in a high dimensional feature space. The proposed method is not computationally expensive since its solution is obtained from a simple linear equation system. In particular, this method is a very attractive approach to modeling nonlinear data, and is nonparametric method in the sense that we do not have to assume the underlying model function for fuzzy nonlinear regression model with crisp inputs and fuzzy output. Experimental results are then presented which indicate the performance of this method.

• The Korean Journal of Applied Statistics
• /
• v.6 no.1
• /
• pp.79-93
• /
• 1993

We consider adaptive L-estimation of estimating slope parameter in regression model. The proposed estimator is simple extension of trimmed least squares estimator proposed by ruppert and carroll. The efficiency of the proposed estimator is especially well compared with usual least squares estimator, least absolute value estimator, and M-estimators designed for asymmetric distributions under asymmetric error distributions.