• Title/Summary/Keyword: least squares

Search Result 2,603, Processing Time 0.024 seconds

MOMENTS OF VARIOGRAM ESTIMATOR FOR A GENERALIZED SKEW t DISTRIBUTION

  • KIM HYOUNG-MOON
    • Journal of the Korean Statistical Society
    • /
    • v.34 no.2
    • /
    • pp.109-123
    • /
    • 2005
  • Variogram estimation is an important step of spatial statistics since it determines the kriging weights. Matheron's variogram estimator can be written as a quadratic form of the observed data. In this paper, we extend a skew t distribution to a generalized skew t distribution and moments of the variogram estimator for a generalized skew t distribution are derived in closed forms. After calculating the correlation structure of the variogram estimator, variogram fitting by generalized least squares is discussed.

Pitfalls in the Application of the COTE in a Linear Regression Model with Seasonal Data

  • Seuck Heun Song;YouSung Park
    • Communications for Statistical Applications and Methods
    • /
    • v.4 no.2
    • /
    • pp.353-358
    • /
    • 1997
  • When the disturbances in the linear repression medel are generated by a seasonal autoregressive scheme the Cochrane Orcutt transformation estimator (COTE) is a well known alternative to Generalized Least Squares estimator (GLSE). In this paper it is analyzed in which situation the Ordinary Least Squares estimator (OLSE) is always better than COTE for positive autocorrelation in terms of efficiency which is here defined as the ratio of the total variances.

  • PDF

GLOBAL MINIMA OF LEAST SQUARES CROSS VALIDATION FOR A SYMMETRIC POLYNOMIAL KEREL WITH FINITE SUPPORT

  • Jung, Kang-Mo;Kim, Byung-Chun
    • Journal of applied mathematics & informatics
    • /
    • v.3 no.2
    • /
    • pp.183-192
    • /
    • 1996
  • The least squares cross validated bandwidth is the mini-mizer of the corss validation function for choosing the smooth parame-ter of a kernel density estimator. It is a completely automatic method but it requires inordinate amounts of computational time. We present a convenient formula for calculation of the cross validation function when the kernel function is a symmetric polynomial with finite sup-port. Also we suggest an algorithm for finding global minima of the crass validation function.

On the Convergence Speed of Nonlinear Least-Squares IIR Adaptive Filter (비선형 무한 응답 최소자승형 적응 여파기의 수렴속도에 관한 연구)

  • 김화종
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • 1987.11a
    • /
    • pp.58-60
    • /
    • 1987
  • In this paper, we investigate an infinite impulse response adaptive digital filter based on the nonlinear least-squares algorithm, and compare its convergence speed to that of a self-orthogonalizing IIR ADF which is known to have fastest convergence. By simulation, it is shown that the NLS IIR ADF converges faster than other known IIR ADF's, especially for a low-order case.

  • PDF

Fast Sequential Least Squares Design of FIR Filters with Linear Phase (고속순차 최소자승법에 의한 선형위상 유한응답 여파기의 설계)

  • 선우종성
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • 1987.11a
    • /
    • pp.79-81
    • /
    • 1987
  • In this paper we propose a fast adaptive least squares algorithm for linear phase FIR filters. The algorithm requires 10m multiplications per data point where m is the filter order. Both linear phase cases with constant phase delay and constant group delay are examined. Simulation results demonstrate that the proeposed algorithm is superior to the LMS gradient algorithm and the averaging scheme used for the modified fast Kalman algorithm.

  • PDF

A Robust Estimation Procedure for the Linear Regression Model

  • Kim, Bu-Yong
    • Journal of the Korean Statistical Society
    • /
    • v.16 no.2
    • /
    • pp.80-91
    • /
    • 1987
  • Minimum $L_i$ norm estimation is a robust procedure ins the sense that it leads to an estimator which has greater statistical eficiency than the least squares estimator in the presence of outliers. And the $L_1$ norm estimator has some desirable statistical properties. In this paper a new computational procedure for $L_1$ norm estimation is proposed which combines the idea of reweighted least squares method and the linear programming approach. A modification of the projective transformation method is employed to solve the linear programming problem instead of the simplex method. It is proved that the proposed algorithm terminates in a finite number of iterations.

  • PDF

Influence Assessment in Robust Regression

  • Sohn, Bang-Yong;Huh, Myung-Hoe
    • Communications for Statistical Applications and Methods
    • /
    • v.4 no.1
    • /
    • pp.21-32
    • /
    • 1997
  • Robust regression based on M-estimator reduces and/or bounds the influence of outliers in the y-direction only. Therefore, when several influential observations exist, diagnostics in the robust regression is required in order to detect them. In this paper, we propose influence diagnostics in the robust regression based on M-estimator and its one-step version. Noting that M-estimator can be obtained through iterative weighted least squares regression by using internal weights, we apply the weighted least squares (WLS) regression diagnostics to robust regression.

  • PDF

Fuzzy c-Regression Using Weighted LS-SVM

  • Hwang, Chang-Ha
    • 한국데이터정보과학회:학술대회논문집
    • /
    • 2005.10a
    • /
    • pp.161-169
    • /
    • 2005
  • In this paper we propose a fuzzy c-regression model based on weighted least squares support vector machine(LS-SVM), which can be used to detect outliers in the switching regression model while preserving simultaneous yielding the estimates of outputs together with a fuzzy c-partitions of data. It can be applied to the nonlinear regression which does not have an explicit form of the regression function. We illustrate the new algorithm with examples which indicate how it can be used to detect outliers and fit the mixed data to the nonlinear regression models.

  • PDF

Variable selection for multiclassi cation by LS-SVM

  • Hwang, Hyung-Tae
    • Journal of the Korean Data and Information Science Society
    • /
    • v.21 no.5
    • /
    • pp.959-965
    • /
    • 2010
  • For multiclassification, it is often the case that some variables are not important while some variables are more important than others. We propose a novel algorithm for selecting such relevant variables for multiclassification. This algorithm is base on multiclass least squares support vector machine (LS-SVM), which uses results of multiclass LS-SVM using one-vs-all method. Experimental results are then presented which indicate the performance of the proposed method.

A new AR power spectral estimation technique using the Karhunen-Loeve Transform (KLT를 이용한 AR 스펙트럼 추정기법에 관한 연구)

  • 공성곤;양흥석
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1986.10a
    • /
    • pp.134-136
    • /
    • 1986
  • In this paper, a new power spectral estimation technique is presented. At first, by transforming the original data with the Karhunen-Loeve Transform(KLT), we can reduce the amount of the redundant information. Next, by modeling the transformed data by means of the autoregressive(AR) model and then applying the least-squares parameter estimation algorithm to this model, even more accurate spectrum estimates can be obtained. The KLT is the optimum transform for signal representation with respect to the mean-square error criterion. And the least-squares method is used to overcome the inherent shortcomings of popular burg algorithm.

  • PDF