• Title/Summary/Keyword: least-squares estimator

Search Result 160, Processing Time 0.031 seconds

Performance Analysis of Quaternion-based Least-squares Methods for GPS Attitude Estimation (GPS 자세각 추정을 위한 쿼터니언 기반 최소자승기법의 성능평가)

  • Won, Jong-Hoon;Kim, Hyung-Cheol;Ko, Sun-Jun;Lee, Ja-Sung
    • Proceedings of the KIEE Conference
    • /
    • 2001.07d
    • /
    • pp.2092-2095
    • /
    • 2001
  • In this paper, the performance of a new alternative form of three-axis attitude estimation algorithm for a rigid body is evaluated via simulation for the situation where the observed vectors are the estimated baselines of a GPS antenna array. This method is derived based on a simple iterative nonlinear least-squares with four elements of quaternion parameter. The representation of quaternion parameters for three-axis attitude of a rigid body is free from singularity problem. The performance of the proposed algorithm is compared with other eight existing methods, such as, Transformation Method (TM), Vector Observation Method (VOM), TRIAD algorithm, two versions of QUaternion ESTimator (QUEST), Singular Value Decomposition (SVD) method, Fast Optimal Attitude Matrix (FOAM), Slower Optimal Matrix Algorithm (SOMA).

  • PDF

Application of Common Random Numbers in Simulation Experiments Using Central Composite Design (중심합성계획 시뮬레이션 실험에서 공통난수의 활용)

  • Kwon, Chi-Myung
    • Journal of the Korea Society for Simulation
    • /
    • v.23 no.3
    • /
    • pp.11-17
    • /
    • 2014
  • The central composite design (CCD) is often used to estimate the second-order linear model. This paper uses a correlation induction strategy of common random numbers (CRN) in simulation experiment and utilizes the induced correlations to obtain better estimates for the second-order linear model. This strategy assigns the CRN to all design points in the CCD. An appropriate selection of the axial points in CCD makes the weighted least squares (WLS) estimator be equivalent to ordinary least squares (OLS) estimator in estimating the linear model parameters of CCD. We analytically investigate the efficiency of this strategy in estimation of model parameters. Under certain conditions, this correlation induction strategy yields better results than independent random number strategy in estimating model parameters except intercept. The simulation experiment on a selected model supports such results. We expect a suggested random number assignment is useful in application of CCD in simulation experiments.

Robust Response Transformation Using Outlier Detection in Regression Model (회귀모형에서 이상치 검색을 이용한 로버스트 변수변환방법)

  • Seo, Han-Son;Lee, Ga-Yoen;Yoon, Min
    • The Korean Journal of Applied Statistics
    • /
    • v.25 no.1
    • /
    • pp.205-213
    • /
    • 2012
  • Transforming response variable is a general tool to adapt data to a linear regression model. However, it is well known that response transformations in linear regression are very sensitive to one or a few outliers. Many methods have been suggested to develop transformations that will not be influenced by potential outliers. Recently Cheng (2005) suggested to using a trimmed likelihood estimator based on the idea of the least trimmed squares estimator(LTS). However, the method requires presetting the number of outliers and needs many computations. A new method is proposed, that can solve the problems addressed and improve the robustness of the estimates. The method uses a stepwise procedure, suggested by Hadi and Simonoff (1993), to detect outliers that determine response transformations.

New Bootstrap Method for Autoregressive Models

  • Hwang, Eunju;Shin, Dong Wan
    • Communications for Statistical Applications and Methods
    • /
    • v.20 no.1
    • /
    • pp.85-96
    • /
    • 2013
  • A new bootstrap method combined with the stationary bootstrap of Politis and Romano (1994) and the classical residual-based bootstrap is applied to stationary autoregressive (AR) time series models. A stationary bootstrap procedure is implemented for the ordinary least squares estimator (OLSE), along with classical bootstrap residuals for estimated errors, and its large sample validity is proved. A finite sample study numerically compares the proposed bootstrap estimator with the estimator based on the classical residual-based bootstrapping. The study shows that the proposed bootstrapping is more effective in estimating the AR coefficients than the residual-based bootstrapping.

Stable activation-based regression with localizing property

  • Shin, Jae-Kyung;Jhong, Jae-Hwan;Koo, Ja-Yong
    • Communications for Statistical Applications and Methods
    • /
    • v.28 no.3
    • /
    • pp.281-294
    • /
    • 2021
  • In this paper, we propose an adaptive regression method based on the single-layer neural network structure. We adopt a symmetric activation function as units of the structure. The activation function has a flexibility of its form with a parametrization and has a localizing property that is useful to improve the quality of estimation. In order to provide a spatially adaptive estimator, we regularize coefficients of the activation functions via ℓ1-penalization, through which the activation functions to be regarded as unnecessary are removed. In implementation, an efficient coordinate descent algorithm is applied for the proposed estimator. To obtain the stable results of estimation, we present an initialization scheme suited for our structure. Model selection procedure based on the Akaike information criterion is described. The simulation results show that the proposed estimator performs favorably in relation to existing methods and recovers the local structure of the underlying function based on the sample.

Structural Design of FCM-based Fuzzy Inference System : A Comparative Study of WLSE and LSE (FCM기반 퍼지추론 시스템의 구조 설계: WLSE 및 LSE의 비교 연구)

  • Park, Wook-Dong;Oh, Sung-Kwun;Kim, Hyun-Ki
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.59 no.5
    • /
    • pp.981-989
    • /
    • 2010
  • In this study, we introduce a new architecture of fuzzy inference system. In the fuzzy inference system, we use Fuzzy C-Means clustering algorithm to form the premise part of the rules. The membership functions standing in the premise part of fuzzy rules do not assume any explicit functional forms, but for any input the resulting activation levels of such radial basis functions directly depend upon the distance between data points by means of the Fuzzy C-Means clustering. As the consequent part of fuzzy rules of the fuzzy inference system (being the local model representing input output relation in the corresponding sub-space), four types of polynomial are considered, namely constant, linear, quadratic and modified quadratic. This offers a significant level of design flexibility as each rule could come with a different type of the local model in its consequence. Either the Least Square Estimator (LSE) or the weighted Least Square Estimator (WLSE)-based learning is exploited to estimate the coefficients of the consequent polynomial of fuzzy rules. In fuzzy modeling, complexity and interpretability (or simplicity) as well as accuracy of the obtained model are essential design criteria. The performance of the fuzzy inference system is directly affected by some parameters such as e.g., the fuzzification coefficient used in the FCM, the number of rules(clusters) and the order of polynomial in the consequent part of the rules. Accordingly we can obtain preferred model structure through an adjustment of such parameters of the fuzzy inference system. Moreover the comparative experimental study between WLSE and LSE is analyzed according to the change of the number of clusters(rules) as well as polynomial type. The superiority of the proposed model is illustrated and also demonstrated with the use of Automobile Miles per Gallon(MPG), Boston housing called Machine Learning dataset, and Mackey-glass time series dataset.

The Use Ridge Regression for Yield Prediction Models with Multicollinearity Problems (수확예측(收穫豫測) Model의 Multicollinearity 문제점(問題點) 해결(解決)을 위(爲)한 Ridge Regression의 이용(利用))

  • Shin, Man Yong
    • Journal of Korean Society of Forest Science
    • /
    • v.79 no.3
    • /
    • pp.260-268
    • /
    • 1990
  • Two types of ridge regression estimators were compared with the ordinary least squares (OLS) estimator in order to select the "best" estimator when multicollinearitc existed. The ridge estimators were Mallows's (1973) $C_P$-like statistic, and Allen's (1974) PRESS-like statistic. The evaluation was conducted based on the predictive ability of a yield model developed by Matney et al. (1988). A total of 522 plots from the data of the Southwide Loblolly Pine Seed Source study was used in this study. All of ridge estimators were better in predictive ability than the OLS estimator. The ridge estimator obtained by using Mallows's statistic performed the best. Thus, ridge estimators can be recommended as an alternative estimator when multicollinearity exists among independent variables.

  • PDF

ROBUST UNIT ROOT TESTS FOR SEASONAL AUTOREGRESSIVE PROCESS

  • Oh, Yu-Jin;So, Beong-Soo
    • Journal of the Korean Statistical Society
    • /
    • v.33 no.2
    • /
    • pp.149-157
    • /
    • 2004
  • The stationarity is one of the most important properties of a time series. We propose robust sign tests for seasonal autoregressive processes to determine whether or not a time series is stationary. The proposed tests are robust to the outliers and the heteroscedastic errors, and they have an exact binomial null distribution regardless of the period of seasonality and types of median adjustments. A Monte-Carlo simulation shows that the sign test is locally more powerful than the tests based on ordinary least squares estimator (OLSE) for heavy-tailed and/or heteroscedastic error distributions.

Efficient Estimation of the Fractal Dimension from Time Series Data Using LTS (Least Trimmed Squares) Estimator for EEG (Encephalogram) Analysis (뇌파 분석을 위한 LTS 추정기법을 이용한 시계열 데이터의 효율적인 프랙탈 차원 추정)

  • 이광호
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 1998.10c
    • /
    • pp.78-80
    • /
    • 1998
  • 본 논문은 일차원의 시계열 데이터를 입력을 하여 위상공간 재구성 과정을 거쳐 다차원 위상공간상에서 프랙탈 차원을 계산하는 효율적인 방법을 제안한다. 프랙탈 차원의 추정에 소요되는 계산량을 줄이기 위해 로그 연산을 비트 연산으로 대체하고, 거리계산의 순서를 바꿈으로써 위상공간의 차원에 무관한 상수 시간의 계산복잡도를 가지는 알고리즘을 구현하였다. 또한 최소절단자승 추정기법을 적용하여 로그-로그 그래프 상에서의 기울기 추정을 함으로써 프랙탈 차원의 추정치에 대한 정확도를 높였다. 참값이 알려진 시계열 데이터에 대한 차원 추정 실험을 통하여 제안된 방법의 정확성을 보였다.

  • PDF

A Unit Root Test Based on Bootstrapping

  • Shin, Key-Il;Kang, Hee-Jeong
    • Communications for Statistical Applications and Methods
    • /
    • v.3 no.1
    • /
    • pp.257-265
    • /
    • 1996
  • We consider nonstationary autoregressive autoregressive process with infinite variance of error. In the case of infinite cariance, the limiting distribution of the estimated coefficient is different from that under the finite cariance assumption. In this paper we show that the bootstrap method can be used to approximate the distribution of ordinary least squares estimator of the coefficient in the first order random walk process with infinite variance through some empirical studies and we suggest a test procedure based on bootstrap method for the unit root test.

  • PDF