• Communications for Statistical Applications and Methods
• /
• v.17 no.2
• /
• pp.141-151
• /
• 2010

Hybrid fuzzy regression analysis is used for integrating randomness and fuzziness into a regression model. Least squares support vector machine(LS-SVM) has been very successful in pattern recognition and function estimation problems for crisp data. This paper proposes a new method to evaluate hybrid fuzzy linear and nonlinear regression models with crisp inputs and fuzzy output using weighted fuzzy arithmetic(WFA) and LS-SVM. LS-SVM allows us to perform fuzzy nonlinear regression analysis by constructing a fuzzy linear regression function in a high dimensional feature space. The proposed method is not computationally expensive since its solution is obtained from a simple linear equation system. In particular, this method is a very attractive approach to modeling nonlinear data, and is nonparametric method in the sense that we do not have to assume the underlying model function for fuzzy nonlinear regression model with crisp inputs and fuzzy output. Experimental results are then presented which indicate the performance of this method.

• Journal of Information Processing Systems
• /
• v.14 no.6
• /
• pp.1385-1397
• /
• 2018

There are many factors that affect the wind speed. In addition, the randomness of wind speed also leads to low prediction accuracy for wind speed. According to this situation, this paper constructs the short-time forecasting model based on the least squares support vector machines (LSSVM) to forecast the wind speed. The basis of the model used in this paper is support vector regression (SVR), which is used to calculate the regression relationships between the historical data and forecasting data of wind speed. In order to improve the forecast precision, historical data is clustered by cluster analysis so that the historical data whose changing trend is similar with the forecasting data can be filtered out. The filtered historical data is used as the training samples for SVR and the parameters would be optimized by particle swarm optimization (PSO). The forecasting model is tested by actual data and the forecast precision is more accurate than the industry standards. The results prove the feasibility and reliability of the model.

• Journal of the Korean Data and Information Science Society
• /
• v.24 no.3
• /
• pp.625-636
• /
• 2013

In this paper we study four kernel machines for estimating expected shortfall, which are constructed through combinations of support vector quantile regression (SVQR), restricted SVQR (RSVQR), least squares support vector machine (LS-SVM) and support vector expectile regression (SVER). These kernel machines have obvious advantages such that they achieve nonlinear model but they do not require the explicit form of nonlinear mapping function. Moreover they need no assumption about the underlying probability distribution of errors. Through numerical studies on two artificial an two real data sets we show their effectiveness on the estimation performance at various confidence levels.

• Journal of the Korean Data and Information Science Society
• /
• v.21 no.3
• /
• pp.461-470
• /
• 2010

Semi supervised classification which is a method using labeled and unlabeled data has considerable attention in recent years. Among various methods the graph based manifold regularization is proved to be an attractive method. Least squares support vector machine is gaining a lot of popularities in analyzing nonlinear data. We propose a semi supervised classification algorithm using the least squares support vector machines. The proposed algorithm is based on the manifold regularization. In this paper we show that the proposed method can use unlabeled data efficiently.

• Journal of the Korean Institute of Gas
• /
• v.16 no.1
• /
• pp.26-32
• /
• 2012

The autoignition temperature is one of the most important physical properties used to determine the flammability characteristics of chemical substances. Despite the needs of the experimental autoignition temperature data for the design of chemical plants, it is not easy to get the data. This study have built and compared partial least squares (PLS) and support vector machine (SVM) models to predict the autoignition temperatures of 503 organic compounds out of DIPPR 801. As the independent variables of the models, 59 functional groups were chosen based on the group contribution method. The prediction errors calculated from cross-validation were employed to determine the optimal parameters of two models. And, particle swarm optimization was used to get three parameters of SVM model. The PLS and SVM results of the average absolute errors for the whole data range from 58.59K and 29.11K, respectively, indicating that the predictive ability of the SVM is much superior than PLS.

• Journal of the Korean Data and Information Science Society
• /
• v.20 no.5
• /
• pp.925-931
• /
• 2009

In this paper we propose a variance function estimation method for replicated data based on averages of squared residuals obtained from estimated mean function by the least squares support vector machine. Newton-Raphson method is used to obtain associated parameter vector for the variance function estimation. Furthermore, the cross validation functions are introduced to select the hyper-parameters which affect the performance of the proposed estimation method. Experimental results are then presented which illustrate the performance of the proposed procedure.

• Journal of the Korean Data and Information Science Society
• /
• v.27 no.3
• /
• pp.827-833
• /
• 2016

In this paper, we propose a deep least squares support vector machine (LS-SVM) for regression problems, which consists of the input layer and the hidden layer. In the hidden layer, LS-SVMs are trained with the original input variables and the perturbed responses. For the final output, the main LS-SVM is trained with the outputs from LS-SVMs of the hidden layer as input variables and the original responses. In contrast to the multilayer neural network (MNN), LS-SVMs in the deep LS-SVM are trained to minimize the penalized objective function. Thus, the learning dynamics of the deep LS-SVM are entirely different from MNN in which all weights and biases are trained to minimize one final error function. When compared to MNN approaches, the deep LS-SVM does not make use of any combination weights, but trains all LS-SVMs in the architecture. Experimental results from real datasets illustrate that the deep LS-SVM significantly outperforms state of the art machine learning methods on regression problems.

• Geomechanics and Engineering
• /
• v.13 no.3
• /
• pp.447-458
• /
• 2017

This study proposes a sensitivity analysis method for slope stability based on the least squares support vector machine (LS-SVM) to examine the influencing factors of slope stability. The method uses LS-SVM as an algorithm for machine learning. An appropriate training dataset is established according to the slope characteristics, and a testing dataset is designed orthogonally. Results of the testing data in the experiment design are calculated after training using the LS-SVM model. The sensitivity of the slope stability of each factor is examined via gray correlation analysis. The results are consistent with those of the traditional Bishop analysis and can be used as a reference for optimizing slope design.

• Journal of the Korean Data and Information Science Society
• /
• v.18 no.3
• /
• pp.735-744
• /
• 2007

Support vector machine(SVM) is capable of providing a more complete description of the linear and nonlinear relationships among random variables. In this paper we propose a sparse kernel regression(SKR) to overcome a weak point of SVM, which is, the steep growth of the number of support vectors with increasing the number of training data. The iterative reweighted least squares(IRWLS) procedure is used to solve the optimal problem of SKR with a Laplacian prior. Furthermore, the generalized cross validation(GCV) function is introduced to select the hyper-parameters which affect the performance of SKR. Experimental results are then presented which illustrate the performance of the proposed procedure.

• Computers and Concrete
• /
• v.18 no.6
• /
• pp.1065-1082
• /
• 2016

The main aim of this study is to predict the compressive and flexural strengths of self-compacting mortar (SCM) containing $nano-SiO_2$, $nano-Fe_2O_3$ and nano-CuO using wavelet-based weighted least squares-support vector machines (WLS-SVM) approach which is called WWLS-SVM. The WWLS-SVM regression model is a relatively new metamodel has been successfully introduced as an excellent machine learning algorithm to engineering problems and has yielded encouraging results. In order to achieve the aim of this study, first, the WLS-SVM and WWLS-SVM models are developed based on a database. In the database, nine variables which consist of cement, sand, NS, NF, NC, superplasticizer dosage, slump flow diameter and V-funnel flow time are considered as the input parameters of the models. The compressive and flexural strengths of SCM are also chosen as the output parameters of the models. Finally, a statistical analysis is performed to demonstrate the generality performance of the models for predicting the compressive and flexural strengths. The numerical results show that both of these metamodels have good performance in the desirable accuracy and applicability. Furthermore, by adopting these predicting metamodels, the considerable cost and time-consuming laboratory tests can be eliminated.