• Title/Summary/Keyword: nonlinear least squares regression

Search Result 59, Processing Time 0.033 seconds

The Comparison Analysis of an Estimators of Nonlinear Regression Model using Monte Carlo Simulation (몬테칼로 시뮬레이션을 이용한 비선형회귀추정량들의 비교 분석)

  • 김태수;이영해
    • Journal of the Korea Society for Simulation
    • /
    • v.9 no.3
    • /
    • pp.43-51
    • /
    • 2000
  • In regression model, we estimate the unknown parameters by using various methods. There are the least squares method which is the most general, the least absolute deviation method, the regression quantile method and the asymmetric least squares method. In this paper, we will compare each others with two cases: firstly the theoretical comparison in the asymptotic sense and then the practical comparison using Monte Carlo simulation for a small sample size.

  • PDF

Monte Carlo simulation of the estimators for nonlinear regression model (비선형 회귀모형 추정량들의 몬데칼로 시뮬레이션에 의한 비교)

  • 김태수;이영해
    • Proceedings of the Korea Society for Simulation Conference
    • /
    • 2000.11a
    • /
    • pp.6-10
    • /
    • 2000
  • In regression model we estimate the unknown parameters using various methods. There are the least squares method which is the most general, the least absolute deviation, the regression quantile and the asymmetric least squares method. In this paper, we will compare each others with two case: to begin with the theoretical comparison in the asymptotic sense, and then the practical comparison using Monte Carlo simulation for a small sample size.

  • PDF

Fuzzy least squares polynomial regression analysis using shape preserving operations

  • Hong, Dug-Hun;Hwang, Chang-Ha;Do, Hae-Young
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.13 no.5
    • /
    • pp.571-575
    • /
    • 2003
  • In this paper, we describe a method for fuzzy polynomial regression analysis for fuzzy input--output data using shape preserving operations for least-squares fitting. Shape preserving operations simplifies the computation of fuzzy arithmetic operations. We derive the solution using mixed nonlinear program.

Prediction Intervals for LS-SVM Regression using the Bootstrap

  • Shim, Joo-Yong;Hwang, Chang-Ha
    • Journal of the Korean Data and Information Science Society
    • /
    • v.14 no.2
    • /
    • pp.337-343
    • /
    • 2003
  • In this paper we present the prediction interval estimation method using bootstrap method for least squares support vector machine(LS-SVM) regression, which allows us to perform even nonlinear regression by constructing a linear regression function in a high dimensional feature space. The bootstrap method is applied to generate the bootstrap sample for estimation of the covariance of the regression parameters consisting of the optimal bias and Lagrange multipliers. Experimental results are then presented which indicate the performance of this algorithm.

  • PDF

Test of the Hypothesis based on Nonlinear Regression Quantiles Estimators

  • Choi, Seung-Hoe
    • Journal of the Korean Data and Information Science Society
    • /
    • v.14 no.2
    • /
    • pp.153-165
    • /
    • 2003
  • This paper considers the likelihood ratio test statistic based on nonlinear regression quantiles estimators in order to test of hypothesis about the regression parameter $\theta_o$ and derives asymptotic distribution of proposed test statistic under the null hypothesis and a sequence of local alternative hypothesis. The paper also investigates asymptotic relative efficiency of the proposed test to the test based on the least squares estimators or the least absolute deviation estimators and gives some examples to illustrate the application of the main result.

  • PDF

EVALUATION OF PARAMETER ESTIMATION METHODS FOR NONLINEAR TIME SERIES REGRESSION MODELS

  • Kim, Tae-Soo;Ahn, Jung-Ho
    • Journal of applied mathematics & informatics
    • /
    • v.27 no.1_2
    • /
    • pp.315-326
    • /
    • 2009
  • The unknown parameters in regression models are usually estimated by using various existing methods. There are several existing methods, such as the least squares method, which is the most common one, the least absolute deviation method, the regression quantile method, and the asymmetric least squares method. For the nonlinear time series regression models, which do not satisfy the general conditions, we will compare them in two ways: 1) a theoretical comparison in the asymptotic sense and 2) an empirical comparison using Monte Carlo simulation for a small sample size.

  • PDF

Expected shortfall estimation using kernel machines

  • Shim, Jooyong;Hwang, Changha
    • Journal of the Korean Data and Information Science Society
    • /
    • v.24 no.3
    • /
    • pp.625-636
    • /
    • 2013
  • In this paper we study four kernel machines for estimating expected shortfall, which are constructed through combinations of support vector quantile regression (SVQR), restricted SVQR (RSVQR), least squares support vector machine (LS-SVM) and support vector expectile regression (SVER). These kernel machines have obvious advantages such that they achieve nonlinear model but they do not require the explicit form of nonlinear mapping function. Moreover they need no assumption about the underlying probability distribution of errors. Through numerical studies on two artificial an two real data sets we show their effectiveness on the estimation performance at various confidence levels.

e-SVR using IRWLS Procedure

  • Shim, Joo-Yong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.16 no.4
    • /
    • pp.1087-1094
    • /
    • 2005
  • e-insensitive support vector regression(e-SVR) is capable of providing more complete description of the linear and nonlinear relationships among random variables. In this paper we propose an iterative reweighted least squares(IRWLS) procedure to solve the quadratic problem of e-SVR with a modified loss function. Furthermore, we introduce the generalized approximate cross validation function to select the hyperparameters which affect the performance of e-SVR. Experimental results are then presented which illustrate the performance of the IRWLS procedure for e-SVR.

  • PDF

On Parameter Estimation of Growth Curves for Technological Forecasting by Using Non-linear Least Squares

  • Ko, Young-Hyun;Hong, Seung-Pyo;Jun, Chi-Hyuck
    • Management Science and Financial Engineering
    • /
    • v.14 no.2
    • /
    • pp.89-104
    • /
    • 2008
  • Growth curves including Bass, Logistic and Gompertz functions are widely used in forecasting the market demand. Nonlinear least square method is often adopted for estimating the model parameters but it is difficult to set up the starting value for each parameter. If a wrong starting point is selected, the result may lead to erroneous forecasts. This paper proposes a method of selecting starting values for model parameters in estimating some growth curves by nonlinear least square method through grid search and transformation into linear regression model. Resealing the market data using the national economic index makes it possible to figure out the range of parameters and to utilize the grid search method. Application to some real data is also included, where the performance of our method is demonstrated.