• 제목/요약/키워드: nonparametric regression

검색결과 191건 처리시간 0.019초

Wavelet Estimation of Regression Functions with Errors in Variables

  • Kim, Woo-Chul;Koo, Ja-Yong
    • Communications for Statistical Applications and Methods
    • /
    • 제6권3호
    • /
    • pp.849-860
    • /
    • 1999
  • This paper addresses the issue of estimating regression function with errors in variables using wavelets. We adopt a nonparametric approach in assuming that the regression function has no specific parametric form, To account for errors in covariates deconvolution is involved in the construction of a new class of linear wavelet estimators. using the wavelet characterization of Besov spaces the question of regression estimation with Besov constraint can be reduced to a problem in a space of sequences. Rates of convergence are studied over Besov function classes $B_{spq}$ using $L_2$ error measure. It is shown that the rates of convergence depend on the smoothness s of the regression function and the decay rate of characteristic function of the contaminating error.

  • PDF

Simultaneous outlier detection and variable selection via difference-based regression model and stochastic search variable selection

  • Park, Jong Suk;Park, Chun Gun;Lee, Kyeong Eun
    • Communications for Statistical Applications and Methods
    • /
    • 제26권2호
    • /
    • pp.149-161
    • /
    • 2019
  • In this article, we suggest the following approaches to simultaneous variable selection and outlier detection. First, we determine possible candidates for outliers using properties of an intercept estimator in a difference-based regression model, and the information of outliers is reflected in the multiple regression model adding mean shift parameters. Second, we select the best model from the model including the outlier candidates as predictors using stochastic search variable selection. Finally, we evaluate our method using simulations and real data analysis to yield promising results. In addition, we need to develop our method to make robust estimates. We will also to the nonparametric regression model for simultaneous outlier detection and variable selection.

베지에 곡선을 이용한 함수의 미분에 대한 비모수적 추정 (Nonparametric estimation of the derivative of function via the Bezier curve)

  • 김충락;정미선;김형순
    • 응용통계연구
    • /
    • 제11권1호
    • /
    • pp.193-204
    • /
    • 1998
  • 주어진 자료를 회귀모형에 적합시켜 적합된 함수의 미분을 구해야 하는 경우가 흔히 있다. 본 논문에서는 베지에 곡선을 이용하여 비모수적으로 추정하는 방법을 소개하고, 실제 자료에 적용시킨다. 이 방법의 장점은 원하는 차수의 미분이 가능할 뿐만 아니라, 비모수 추정에 따르는 커널의 선택과정이 필요없고 단지 평활모수만 선택하면 된다.

  • PDF

Effective Computation for Odds Ratio Estimation in Nonparametric Logistic Regression

  • Kim, Young-Ju
    • Communications for Statistical Applications and Methods
    • /
    • 제16권4호
    • /
    • pp.713-722
    • /
    • 2009
  • The estimation of odds ratio and corresponding confidence intervals for case-control data have been done by traditional generalized linear models which assumed that the logarithm of odds ratio is linearly related to risk factors. We adapt a lower-dimensional approximation of Gu and Kim (2002) to provide a faster computation in nonparametric method for the estimation of odds ratio by allowing flexibility of the estimating function and its Bayesian confidence interval under the Bayes model for the lower-dimensional approximations. Simulation studies showed that taking larger samples with the lower-dimensional approximations help to improve the smoothing spline estimates of odds ratio in this settings. The proposed method can be used to analyze case-control data in medical studies.

편스플라인 추정량의 편의에 대한 점근 정규성 (Asymptotics Normality for Bias fo Partial Spline Estimator)

  • 추인선;최재룡
    • 응용통계연구
    • /
    • 제13권2호
    • /
    • pp.371-381
    • /
    • 2000
  • 비모수 회귀모형에 있어서 평활스플라인에 대하여 언급하고, 그 간단한 성질을 다룬다. 선형회귀나 다항식회귀에서는 적합하기 나쁜 데이터가 많이 존재한다. 설명변수가 여러 개인 경우에 준모수 회귀모형은 하나 혹은 그 이상의 변수에 대해서는 비모수 함수를 다른 변수에 대하서는 선형함수를 적합시켜 그들의 가법성을 가정한 것이다. 준모수 회귀모형에 있어서 선형부분의 회귀계수의 추정량에 편의가 발생하고, 여기서는 그 편의에 대한 점근 정규성을 다룬다

  • PDF

Multivariate adaptive regression splines model for reliability assessment of serviceability limit state of twin caverns

  • Zhang, Wengang;Goh, Anthony T.C.
    • Geomechanics and Engineering
    • /
    • 제7권4호
    • /
    • pp.431-458
    • /
    • 2014
  • Construction of a new cavern close to an existing cavern will result in a modification of the state of stresses in a zone around the existing cavern as interaction between the twin caverns takes place. Extensive plane strain finite difference analyses were carried out to examine the deformations induced by excavation of underground twin caverns. From the numerical results, a fairly simple nonparametric regression algorithm known as multivariate adaptive regression splines (MARS) has been used to relate the maximum key point displacement and the percent strain to various parameters including the rock quality, the cavern geometry and the in situ stress. Probabilistic assessments on the serviceability limit state of twin caverns can be performed using the First-order reliability spreadsheet method (FORM) based on the built MARS model. Parametric studies indicate that the probability of failure $P_f$ increases as the coefficient of variation of Q increases, and $P_f$ decreases with the widening of the pillar.

Nonlinear structural modeling using multivariate adaptive regression splines

  • Zhang, Wengang;Goh, A.T.C.
    • Computers and Concrete
    • /
    • 제16권4호
    • /
    • pp.569-585
    • /
    • 2015
  • Various computational tools are available for modeling highly nonlinear structural engineering problems that lack a precise analytical theory or understanding of the phenomena involved. This paper adopts a fairly simple nonparametric adaptive regression algorithm known as multivariate adaptive regression splines (MARS) to model the nonlinear interactions between variables. The MARS method makes no specific assumptions about the underlying functional relationship between the input variables and the response. Details of MARS methodology and its associated procedures are introduced first, followed by a number of examples including three practical structural engineering problems. These examples indicate that accuracy of the MARS prediction approach. Additionally, MARS is able to assess the relative importance of the designed variables. As MARS explicitly defines the intervals for the input variables, the model enables engineers to have an insight and understanding of where significant changes in the data may occur. An example is also presented to demonstrate how the MARS developed model can be used to carry out structural reliability analysis.

Hybrid Fuzzy Least Squares Support Vector Machine Regression for Crisp Input and Fuzzy Output

  • Shim, Joo-Yong;Seok, Kyung-Ha;Hwang, Chang-Ha
    • Communications for Statistical Applications and Methods
    • /
    • 제17권2호
    • /
    • pp.141-151
    • /
    • 2010
  • Hybrid fuzzy regression analysis is used for integrating randomness and fuzziness into a regression model. Least squares support vector machine(LS-SVM) has been very successful in pattern recognition and function estimation problems for crisp data. This paper proposes a new method to evaluate hybrid fuzzy linear and nonlinear regression models with crisp inputs and fuzzy output using weighted fuzzy arithmetic(WFA) and LS-SVM. LS-SVM allows us to perform fuzzy nonlinear regression analysis by constructing a fuzzy linear regression function in a high dimensional feature space. The proposed method is not computationally expensive since its solution is obtained from a simple linear equation system. In particular, this method is a very attractive approach to modeling nonlinear data, and is nonparametric method in the sense that we do not have to assume the underlying model function for fuzzy nonlinear regression model with crisp inputs and fuzzy output. Experimental results are then presented which indicate the performance of this method.

Efficient Score Estimation and Adaptive Rank and M-estimators from Left-Truncated and Right-Censored Data

  • Chul-Ki Kim
    • Communications for Statistical Applications and Methods
    • /
    • 제3권3호
    • /
    • pp.113-123
    • /
    • 1996
  • Data-dependent (adaptive) choice of asymptotically efficient score functions for rank estimators and M-estimators of regression parameters in a linear regression model with left-truncated and right-censored data are developed herein. The locally adaptive smoothing techniques of Muller and Wang (1990) and Uzunogullari and Wang (1992) provide good estimates of the hazard function h and its derivative h' from left-truncated and right-censored data. However, since we need to estimate h'/h for the asymptotically optimal choice of score functions, the naive estimator, which is just a ratio of estimated h' and h, turns out to have a few drawbacks. An altermative method to overcome these shortcomings and also to speed up the algorithms is developed. In particular, we use a subroutine of the PPR (Projection Pursuit Regression) method coded by Friedman and Stuetzle (1981) to find the nonparametric derivative of log(h) for the problem of estimating h'/h.

  • PDF

Structural Change in the Price-Dividend Ratio and Implications on Stock Return Prediction Regression

  • Lee, Ho-Jin
    • 재무관리연구
    • /
    • 제24권2호
    • /
    • pp.183-206
    • /
    • 2007
  • The price-dividend ratio is one of the most frequently used financial variables to predict long-horizon stock return. However, the persistency of the price-dividend ratio is found to cause the spuriousness of the stock return prediction regression. The stable relationship between the stock price and the dividend, however, seems to weaken after World War II and to experience structural break. In this paper, we identify a structural change in the cointegrating relationship between the log of the stock price and the log of the dividend. Confirming a structural break in 1962, we subdivide the sample and apply the fully modified estimator to correct for the nonstationarity of the regressor. With the subdivided sample, we exercise the nonparametric bootstrap procedure to derive the empirical distribution of the test statistics and fail to find return predictability in each subsample period.

  • PDF