• Title/Summary/Keyword: Regression estimator

Search Result 311, Processing Time 0.025 seconds

A Graphical Method for Evaluating the Mixture Component Effects of Ridge Regression Estimator in Mixture Experiments

  • Jang, Dae-Heung
    • Communications for Statistical Applications and Methods
    • /
    • v.6 no.1
    • /
    • pp.1-10
    • /
    • 1999
  • When the component proportions in mixture experiments are restricted by lower and upper bounds multicollinearity appears all too frequently. The ridge regression can be used to stabilize the coefficient estimates in the fitted model. I propose a graphical method for evaluating the mixture component effects of ridge regression estimator with respect to the prediction variance and the prediction bias.

  • PDF

Asymptotic Properties of a Robust Estimator for Regression Models with Random Regressor

  • Chang, Sook-Hee;Kim, Hae-Kyung
    • Communications for Statistical Applications and Methods
    • /
    • v.6 no.2
    • /
    • pp.345-356
    • /
    • 1999
  • This paper deals with the problem of estimating regression coefficients in nonlinear regression model having random regressor. The sufficient conditions for consistency of the $L_1$-estimator with random regressor are given and discussed in this paper. An example is given to illustrate the application of the main results.

  • PDF

Adaptive Regression by Mixing for Fixed Design

  • Oh, Jong-Chul;Lu, Yun;Yang, Yuhong
    • Communications for Statistical Applications and Methods
    • /
    • v.12 no.3
    • /
    • pp.713-727
    • /
    • 2005
  • Among different regression approaches, nonparametric procedures perform well under different conditions. In practice it is very hard to identify which is the best procedure for the data at hand, thus model combination is of practical importance. In this paper, we focus on one dimensional regression with fixed design. Polynomial regression, local regression, and smoothing spline are considered. The data are split into two parts, one part is used for estimation and the other part is used for prediction. Prediction performances are used to assign weights to different regression procedures. Simulation results show that the combined estimator performs better or similarly compared with the estimator chosen by cross validation. The combined estimator generates a similar risk to the best candidate procedure for the data.

An estimator of the mean of the squared functions for a nonparametric regression

  • Park, Chun-Gun
    • Journal of the Korean Data and Information Science Society
    • /
    • v.20 no.3
    • /
    • pp.577-585
    • /
    • 2009
  • So far in a nonparametric regression model one of the interesting problems is estimating the error variance. In this paper we propose an estimator of the mean of the squared functions which is the numerator of SNR (Signal to Noise Ratio). To estimate SNR, the mean of the squared function should be firstly estimated. Our focus is on estimating the amplitude, that is the mean of the squared functions, in a nonparametric regression using a simple linear regression model with the quadratic form of observations as the dependent variable and the function of a lag as the regressor. Our method can be extended to nonparametric regression models with multivariate functions on unequally spaced design points or clustered designed points.

  • PDF

Autocovariance based estimation in the linear regression model (선형회귀 모형에서 자기공분산 기반 추정)

  • Park, Cheol-Yong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.22 no.5
    • /
    • pp.839-847
    • /
    • 2011
  • In this study, we derive an estimator based on autocovariance for the regression coefficients vector in the multiple linear regression model. This method is suggested by Park (2009), and although this method does not seem to be intuitively attractive, this estimator is unbiased for the regression coefficients vector. When the vectors of exploratory variables satisfy some regularity conditions, under mild conditions which are satisfied when errors are from autoregressive and moving average models, this estimator has asymptotically the same distribution as the least squares estimator and also converges in probability to the regression coefficients vector. Finally we provide a simulation study that the forementioned theoretical results hold for small sample cases.

Reexamination of Estimating Beta Coecient as a Risk Measure in CAPM

  • Phuoc, Le Tan;Kim, Kee S.;Su, Yingcai
    • The Journal of Asian Finance, Economics and Business
    • /
    • v.5 no.1
    • /
    • pp.11-16
    • /
    • 2018
  • This research examines the alternative ways of estimating the coefficient of non-diversifiable risk, namely beta coefficient, in Capital Asset Pricing Model (CAPM) introduced by Sharpe (1964) that is an essential element of assessing the value of diverse assets. The non-parametric methods used in this research are the robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator). The Jackknife, the resampling technique, is also employed to validate the results. According to finance literature and common practices, these coecients have often been estimated using Ordinary Least Square (LS) regression method and monthly return data set. The empirical results of this research pointed out that the robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator) performed much better than Ordinary Least Square (LS) in terms of eciency for large-cap stocks trading actively in the United States markets. Interestingly, the empirical results also showed that daily return data would give more accurate estimation than monthly return data in both Ordinary Least Square (LS) and robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator) regressions.

Comparison of Survival Function Estimators for the Cox's Regression Model using Bootstrap Method (Cox 회귀모형(回歸模型)에서 붓스트랩방법(方法)에 의한 생존함수추정량(生存函數推定量)의 비교연구(比較硏究))

  • Cha, Young-Joon
    • Journal of the Korean Data and Information Science Society
    • /
    • v.4
    • /
    • pp.1-11
    • /
    • 1993
  • The Cox's regression model is frequently used for covariate effects in survival data analysis, But, much of the statistical work has focused on asymptotic behavior so the small sample evaluation has been neglected. In this paper, we compare the small or moderate sample performances of the survival function estimators for the Cox's regression model using bootstrap method. The smoothed PL type estimator and the Link estimator are slightly better than corresponding the PL type estimator and the Nelson type estimator in the sense of the achieved error rates.

  • PDF

On the Robustness of $L_1$-estimator in Linear Regression Models

  • Bu-Yong Kim
    • Communications for Statistical Applications and Methods
    • /
    • v.2 no.2
    • /
    • pp.277-287
    • /
    • 1995
  • It is well kmown that the $L_1$-estimator is robust with respect to vertical outliers in regression data, even if it is susceptible to bad leverage points. This article is concerned with the robustness of the $L_1$-estimator. To investigate its robustness against vertical outliers we may find intervals for the value of the response variable within which the $L_1$-estimates do not shange. A procedure for constructing those intervals in multiple limear regression is illustrated in the sensitivity analysis context. And then vertical breakdown point of the $L_1$-estimator is defined on the basis of properties related to those intervals.

  • PDF

The Efficiency of the Cochrane-Orcutt Estimation Procedure in Autocorrelated Regression Models

  • Song, Seuck-Heun;Myoungshic Jhun;Jung, Byoung-Cheol
    • Journal of the Korean Statistical Society
    • /
    • v.27 no.3
    • /
    • pp.319-329
    • /
    • 1998
  • In the linear regression model with an autocorrelated disturbances, the Cochrane-Orcutt estimator (COE) is a well known alternative to the Generalized Least Squares estimator (GLSE). The efficiency of COE has been studied empirically in a Monte Carlo study when the unknown parameters are estimated by maximum likelihood method. In this paper, it is theoretically proved that the COE is shown to be inferior to the GLSE. The comparisons are based on the difference of corresponding information matrices or the ratio of their determinants.

  • PDF

EFFICIENT REPLICATION VARIANCE ESTIMATION FOR TWO-PHASE SAMPLING

  • Kim, Jae-Kwang;Sitter, Randy
    • Proceedings of the Korean Statistical Society Conference
    • /
    • 2002.11a
    • /
    • pp.327-332
    • /
    • 2002
  • Variance estimation for the regression estimator for a two-phase sample is investigated. A replication variance estimator with number of replicates equal to or slightly larger than the size of the second-phase sample is developed. In these cases, the proposed method is asymptotically equivalent to the full jackknife, but uses smaller number of replications.

  • PDF