• Title/Summary/Keyword: Support Vector Regression

Search Result 524, Processing Time 0.026 seconds

River stage forecasting models using support vector regression and optimization algorithms (Support vector regression과 최적화 알고리즘을 이용한 하천수위 예측모델)

  • Seo, Youngmin;Kim, Sungwon
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2015.05a
    • /
    • pp.606-609
    • /
    • 2015
  • 본 연구에서는 support vector regression (SVR) 및 매개변수 최적화 알고리즘을 이용한 하천수위 예측모델을 구축하고 이를 실제 유역에 적용하여 모델 효율성을 평가하였다. 여기서, SVR은 하천수위를 예측하기 위한 예측모델로서 채택되었으며, 커널함수 (Kernel function)로서는 radial basis function (RBF)을 선택하였다. 최적화 알고리즘은 SVR의 최적 매개변수 (C?, cost parameter or regularization parameter; ${\gamma}$, RBF parameter; ${\epsilon}$, insensitive loss function parameter)를 탐색하기 위하여 적용되었다. 매개변수 최적화 알고리즘으로는 grid search (GS), genetic algorithm (GA), particle swarm optimization (PSO), artificial bee colony (ABC) 알고리즘을 채택하였으며, 비교분석을 통해 최적화 알고리즘의 적용성을 평가하였다. 또한 SVR과 최적화 알고리즘을 결합한 모델 (SVR-GS, SVR-GA, SVR-PSO, SVR-ABC)은 기존에 수자원 분야에서 널리 적용되어온 신경망(Artificial neural network, ANN) 및 뉴로퍼지 (Adaptive neuro-fuzzy inference system, ANFIS) 모델과 비교하였다. 그 결과, 모델 효율성 측면에서 SVR-GS, SVR-GA, SVR-PSO 및 SVR-ABC는 ANN보다 우수한 결과를 나타내었으며, ANFIS와는 비슷한 결과를 나타내었다. 또한 SVR-GA, SVR-PSO 및 SVR-ABC는 SVR-GS보다 상대적으로 우수한 결과를 나타내었으며, 모델 효율성 측면에서 SVR-PSO 및 SVR-ABC는 가장 우수한 모델 성능을 나타내었다. 따라서 본 연구에서 적용한 매개변수 최적화 알고리즘은 SVR의 매개변수를 최적화하는데 효과적임을 확인할 수 있었다. SVR과 최적화 알고리즘을 이용한 하천수위 예측모델은 기존의 ANN 및 ANFIS 모델과 더불어 하천수위 예측을 위한 효과적인 도구로 사용될 수 있을 것으로 판단된다.

  • PDF

Real-Time Prediction for Product Surface Roughness by Support Vector Regression (서포트벡터 회귀를 이용한 실시간 제품표면거칠기 예측)

  • Choi, Sujin;Lee, Dongju
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.44 no.3
    • /
    • pp.117-124
    • /
    • 2021
  • The development of IOT technology and artificial intelligence technology is promoting the smartization of manufacturing system. In this study, data extracted from acceleration sensor and current sensor were obtained through experiments in the cutting process of SKD11, which is widely used as a material for special mold steel, and the amount of tool wear and product surface roughness were measured. SVR (Support Vector Regression) is applied to predict the roughness of the product surface in real time using the obtained data. SVR, a machine learning technique, is widely used for linear and non-linear prediction using the concept of kernel. In particular, by applying GSVQR (Generalized Support Vector Quantile Regression), overestimation, underestimation, and neutral estimation of product surface roughness are performed and compared. Furthermore, surface roughness is predicted using the linear kernel and the RBF kernel. In terms of accuracy, the results of the RBF kernel are better than those of the linear kernel. Since it is difficult to predict the amount of tool wear in real time, the product surface roughness is predicted with acceleration and current data excluding the amount of tool wear. In terms of accuracy, the results of excluding the amount of tool wear were not significantly different from those including the amount of tool wear.

Mechanical Parameter Identification of Servo Systems using Robust Support Vector Regression (Support Vector Regression을 이용한 서보 시스템의 기계적 상수 추정)

  • Cho Kyung-Rae;Seok Jul-Ki;Lee Dong-Choon
    • Proceedings of the KIPE Conference
    • /
    • 2004.07b
    • /
    • pp.738-741
    • /
    • 2004
  • The overall performance of AC servo system is greatly affected by the uncertainties of unpredictable mechanical parameter variations and external load disturbances. Therefore, to compensate this problem, it is necessary to know different parameters and load disturbances subjected to position/speed control. This paper proposes an online identification method of mechanical parameters/load disturbances for AC servo system using Support Vector Regression (SVR). The proposed methodology advocates analytic parameter regression directly from the training data, rather than adaptive controller and observer approaches commonly used in motion control applications. The experimental results demonstrate that the proposed SVR algorithm is appropriate for control of unknown servo systems even with large measurement noise.

  • PDF

Geographically weighted least squares-support vector machine

  • Hwang, Changha;Shim, Jooyong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.28 no.1
    • /
    • pp.227-235
    • /
    • 2017
  • When the spatial information of each location is given specifically as coordinates it is popular to use the geographically weighted regression to incorporate the spatial information by assuming that the regression parameters vary spatially across locations. In this paper, we relax the linearity assumption of geographically weighted regression and propose a geographically weighted least squares-support vector machine for estimating geographically weighted mean by using the basic concept of kernel machines. Generalized cross validation function is induced for the model selection. Numerical studies with real datasets have been conducted to compare the performance of proposed method with other methods for predicting geographically weighted mean.

Speed Estimation of PMSM Using Support Vector Regression (SVM Regression을 이용한 PMSM의 속도 추정)

  • Han Dong Chang;Back Woon Jae;Kim Seong Rag;Kim Han Kil;Shim Jun Hong;Park Kwang Won;Lee Suk Gyu;Park Jung Il
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.11 no.7
    • /
    • pp.565-571
    • /
    • 2005
  • We present a novel speed estimation of a Permanent Magnet Synchronous Motor(PMSM) based on Support Vector Regression(SVR). The proposed method can estimate wide speed range, including 0.33Hz with full load, accurately in the steady and transient states where motor parameters variations are known without parameter estimator. Moreover, the method does not need offline training previously but is trained on-line. The training starts with the PMSM operation simultaneously and estimates the speed in real time. The experimental results shows the validity and the usefulness of the proposed algorithm for the 0.4Kw PMSM DSP(TMS320VC33) drive system.

Support vector quantile regression ensemble with bagging

  • Shim, Jooyong;Hwang, Changha
    • Journal of the Korean Data and Information Science Society
    • /
    • v.25 no.3
    • /
    • pp.677-684
    • /
    • 2014
  • Support vector quantile regression (SVQR) is capable of providing more complete description of the linear and nonlinear relationships among random variables. To improve the estimation performance of SVQR we propose to use SVQR ensemble with bagging (bootstrap aggregating), in which SVQRs are trained independently using the training data sets sampled randomly via a bootstrap method. Then, they are aggregated to obtain the estimator of the quantile regression function using the penalized objective function composed of check functions. Experimental results are then presented, which illustrate the performance of SVQR ensemble with bagging.

Estimation of software project effort with genetic algorithm and support vector regression (유전 알고리즘 기반의 서포트 벡터 회귀를 이용한 소프트웨어 비용산정)

  • Kwon, Ki-Tae;Park, Soo-Kwon
    • The KIPS Transactions:PartD
    • /
    • v.16D no.5
    • /
    • pp.729-736
    • /
    • 2009
  • The accurate estimation of software development cost is important to a successful development in software engineering. Until recent days, the model using regression analysis based on statistical algorithm and machine learning method have been used. However, this paper estimates the software cost using support vector regression, a sort of machine learning technique. Also, it finds the best set of optimized parameters applying genetic algorithm. The proposed GA-SVR model outperform some recent results reported in the literature.

Sparse Kernel Regression using IRWLS Procedure

  • Park, Hye-Jung
    • Journal of the Korean Data and Information Science Society
    • /
    • v.18 no.3
    • /
    • pp.735-744
    • /
    • 2007
  • Support vector machine(SVM) is capable of providing a more complete description of the linear and nonlinear relationships among random variables. In this paper we propose a sparse kernel regression(SKR) to overcome a weak point of SVM, which is, the steep growth of the number of support vectors with increasing the number of training data. The iterative reweighted least squares(IRWLS) procedure is used to solve the optimal problem of SKR with a Laplacian prior. Furthermore, the generalized cross validation(GCV) function is introduced to select the hyper-parameters which affect the performance of SKR. Experimental results are then presented which illustrate the performance of the proposed procedure.

  • PDF

Hybrid Fuzzy Least Squares Support Vector Machine Regression for Crisp Input and Fuzzy Output

  • Shim, Joo-Yong;Seok, Kyung-Ha;Hwang, Chang-Ha
    • Communications for Statistical Applications and Methods
    • /
    • v.17 no.2
    • /
    • pp.141-151
    • /
    • 2010
  • Hybrid fuzzy regression analysis is used for integrating randomness and fuzziness into a regression model. Least squares support vector machine(LS-SVM) has been very successful in pattern recognition and function estimation problems for crisp data. This paper proposes a new method to evaluate hybrid fuzzy linear and nonlinear regression models with crisp inputs and fuzzy output using weighted fuzzy arithmetic(WFA) and LS-SVM. LS-SVM allows us to perform fuzzy nonlinear regression analysis by constructing a fuzzy linear regression function in a high dimensional feature space. The proposed method is not computationally expensive since its solution is obtained from a simple linear equation system. In particular, this method is a very attractive approach to modeling nonlinear data, and is nonparametric method in the sense that we do not have to assume the underlying model function for fuzzy nonlinear regression model with crisp inputs and fuzzy output. Experimental results are then presented which indicate the performance of this method.

Incremental Support Vector Learning Method for Function Approximation (함수 근사를 위한 점증적 서포트 벡터 학습 방법)

  • 임채환;박주영
    • Proceedings of the IEEK Conference
    • /
    • 2002.06c
    • /
    • pp.135-138
    • /
    • 2002
  • This paper addresses incremental learning method for regression. SVM(support vector machine) is a recently proposed learning method. In general training a support vector machine requires solving a QP (quadratic programing) problem. For very large dataset or incremental dataset, solving QP problems may be inconvenient. So this paper presents an incremental support vector learning method for function approximation problems.

  • PDF