• Title/Summary/Keyword: regression function

Search Result 2,134, Processing Time 0.024 seconds

e-SVR using IRWLS Procedure

  • Shim, Joo-Yong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.16 no.4
    • /
    • pp.1087-1094
    • /
    • 2005
  • e-insensitive support vector regression(e-SVR) is capable of providing more complete description of the linear and nonlinear relationships among random variables. In this paper we propose an iterative reweighted least squares(IRWLS) procedure to solve the quadratic problem of e-SVR with a modified loss function. Furthermore, we introduce the generalized approximate cross validation function to select the hyperparameters which affect the performance of e-SVR. Experimental results are then presented which illustrate the performance of the IRWLS procedure for e-SVR.

  • PDF

Mixed-effects LS-SVR for longitudinal dat

  • Cho, Dae-Hyeon
    • Journal of the Korean Data and Information Science Society
    • /
    • v.21 no.2
    • /
    • pp.363-369
    • /
    • 2010
  • In this paper we propose a mixed-effects least squares support vector regression (LS-SVR) for longitudinal data. We add a random-effect term in the optimization function of LS-SVR to take random effects into LS-SVR for analyzing longitudinal data. We also present the model selection method that employs generalized cross validation function for choosing the hyper-parameters which affect the performance of the mixed-effects LS-SVR. A simulated example is provided to indicate the usefulness of mixed-effect method for analyzing longitudinal data.

Local linear regression analysis for interval-valued data

  • Jang, Jungteak;Kang, Kee-Hoon
    • Communications for Statistical Applications and Methods
    • /
    • v.27 no.3
    • /
    • pp.365-376
    • /
    • 2020
  • Interval-valued data, a type of symbolic data, is given as an interval in which the observation object is not a single value. It can also occur frequently in the process of aggregating large databases into a form that is easy to manage. Various regression methods for interval-valued data have been proposed relatively recently. In this paper, we introduce a nonparametric regression model using the kernel function and a nonlinear regression model for the interval-valued data. We also propose applying the local linear regression model, one of the nonparametric methods, to the interval-valued data. Simulations based on several distributions of the center point and the range are conducted using each of the methods presented in this paper. Various conditions confirm that the performance of the proposed local linear estimator is better than the others.

Locally Weighted Polynomial Forecasting Model (지역가중다항식을 이용한 예측모형)

  • Mun, Yeong-Il
    • Journal of Korea Water Resources Association
    • /
    • v.33 no.1
    • /
    • pp.31-38
    • /
    • 2000
  • Relationships between hydrologic variables are often nonlinear. Usually the functional form of such a relationship is not known a priori. A multivariate, nonparametric regression methodology is provided here for approximating the underlying regression function using locally weighted polynomials. Locally weighted polynomials consider the approximation of the target function through a Taylor series expansion of the function in the neighborhood of the point of estimate. The utility of this nonparametric regression approach is demonstrated through an application to nonparametric short term forecasts of the biweekly Great Salt Lake volume.volume.

  • PDF

Support Vector Quantile Regression Using Asymmetric e-Insensitive Loss Function

  • Shim, Joo-Yong;Seok, Kyung-Ha;Hwang, Chang-Ha;Cho, Dae-Hyeon
    • Communications for Statistical Applications and Methods
    • /
    • v.18 no.2
    • /
    • pp.165-170
    • /
    • 2011
  • Support vector quantile regression(SVQR) is capable of providing a good description of the linear and nonlinear relationships among random variables. In this paper we propose a sparse SVQR to overcome a limitation of SVQR, nonsparsity. The asymmetric e-insensitive loss function is used to efficiently provide sparsity. The experimental results are presented to illustrate the performance of the proposed method by comparing it with nonsparse SVQR.

On relationship among h value, membership function, and spread in fuzzy linear regression using shape-preserving operations

  • Hong, Dug-Hun
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2008.04a
    • /
    • pp.306-310
    • /
    • 2008
  • Fuzzy regression, a nonparametric method, can be quite useful in estimating the relationships among variables where the available data are very limited and imprecise. It can also serve as a sound methodology that can be applied to a variety of management and engineering problems where variables are interacting in an uncertain, qualitative, and fuzzy way. A close examination of the fuzzy regression algorithm reveals that the resulting possibility distribution of fuzzy parameters, which makes this technique attractive in a fuzzy environment, is dependent upon an h parameter value. The h value, which is between 0 and 1, is referred to as the degree of fit of the estimated fuzzy linear model to the given data, and is subjectively selected by a decision maker (DM) as an input to the model. The selection of a proper value of h is important in fuzzy regression, because it determines the range of the posibility ditributions of the fuzzy parameters. In this paper, we discuss the interdependent relationship among the h value, membership function shape, and the spreads of fuzzy parameters in fuzzy linear regression with fuzzy input-output using shape-preserving operations.

  • PDF

Relationship Among h Value, Membership Function, and Spread in Fuzzy Linear Regression using Shape-preserving Operations

  • Hong, Dug-Hun
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.8 no.4
    • /
    • pp.306-311
    • /
    • 2008
  • Fuzzy regression, a nonparametric method, can be quite useful in estimating the relationships among variables where the available data are very limited and imprecise. It can also serve as a sound methodology that can be applied to a variety of management and engineering problems where variables are interacting in an uncertain, qualitative, and fuzzy way. A close examination of the fuzzy regression algorithm reveals that the resulting possibility distribution of fuzzy parameters, which makes this technique attractive in a fuzzy environment, is dependent upon an h parameter value. The h value, which is between 0 and 1, is referred to as the degree of fit of the estimated fuzzy linear model to the given data, and is subjectively selected by a decision maker (DM) as an input to the model. The selection of a proper value of h is important in fuzzy regression, because it determines the range of the posibility ditributions of the fuzzy parameters. In this paper, we discuss the interdependent relationship among the h value, membership function shape, and the spreads of fuzzy parameters in fuzzy linear regression with fuzzy input-output using shape-preserving operations.

The Effect of Vitamin D and Calcium on Cognitive Function and Depression in the Elderly Living in a City

  • Lee, Yu-Jin;Kim, Yun-Su
    • Research in Community and Public Health Nursing
    • /
    • v.28 no.3
    • /
    • pp.251-259
    • /
    • 2017
  • Purpose: This study aims to examine the influence of vitamin D and calcium on depression and cognitive function of the elderly living alone in a city. Methods: The participants were registered in eight senior centers in S city and they had lived alone. Data were collected between November 28, 2014 and March 7, 2015. A total of 155 people participated in data collection to measure the serum vitamin D, the serum calcium, depression, and cognitive function. The data were analyzed with t-test, ANOVA, Pearson's correlation and multiple regression analysis. Results: There were significant differences in depression according to gender and perceptions of health status. Depression correlated significantly with the serum calcium and perceptions of health status, and a stepwise regression analysis showed that the perceptions of health status were significant. There were significant differences in cognitive function according to education level and age. Cognitive function correlated significantly with the serum vitamin D and a stepwise regression analysis showed that education level and age were significant. Conclusion: Consequently, elderly people with poor perceptions of their health status need a depressive intervention program and those with a higher age and lower level of education need a cognitive function intervention program.

Performance Evaluation of Linear Regression, Back-Propagation Neural Network, and Linear Hebbian Neural Network for Fitting Linear Function (선형함수 fitting을 위한 선형회귀분석, 역전파신경망 및 성현 Hebbian 신경망의 성능 비교)

  • 이문규;허해숙
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.20 no.3
    • /
    • pp.17-29
    • /
    • 1995
  • Recently, neural network models have been employed as an alternative to regression analysis for point estimation or function fitting in various field. Thus far, however, no theoretical or empirical guides seem to exist for selecting the tool which the most suitable one for a specific function-fitting problem. In this paper, we evaluate performance of three major function-fitting techniques, regression analysis and two neural network models, back-propagation and linear-Hebbian-learning neural networks. The functions to be fitted are simple linear ones of a single independent variable. The factors considered are size of noise both in dependent and independent variables, portion of outliers, and size of the data. Based on comutational results performed in this study, some guidelines are suggested to choose the best technique that can be used for a specific problem concerned.

  • PDF

Robust varying coefficient model using L1 regularization

  • Hwang, Changha;Bae, Jongsik;Shim, Jooyong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.27 no.4
    • /
    • pp.1059-1066
    • /
    • 2016
  • In this paper we propose a robust version of varying coefficient models, which is based on the regularized regression with L1 regularization. We use the iteratively reweighted least squares procedure to solve L1 regularized objective function of varying coefficient model in locally weighted regression form. It provides the efficient computation of coefficient function estimates and the variable selection for given value of smoothing variable. We present the generalized cross validation function and Akaike information type criterion for the model selection. Applications of the proposed model are illustrated through the artificial examples and the real example of predicting the effect of the input variables and the smoothing variable on the output.