• Communications for Statistical Applications and Methods
• /
• v.17 no.6
• /
• pp.803-810
• /
• 2010

The singular value decomposition of a rectangular matrix is a basic tool to understand the structure of the data and particularly the relationship between row and column factors. However, conventional singular value decomposition used the least squares method and is not robust to outliers. We propose a simple robust singular value decomposition algorithm based on the weighted least absolute deviation which is not sensitive to leverage points. Its implementation is easy and the computation time is reasonably low. Numerical results give the data structure and the outlying information.

• The Transactions of the Korean Institute of Electrical Engineers
• /
• v.41 no.9
• /
• pp.1021-1030
• /
• 1992

When using a least squares estimator with exponential forgetting factor to identify continuous-time deterministic system, the problem of determining minimum eigenvalue is described in this paper. It is well known fact that the convergence rate of parameter estimates relies on various factors consisting of the estimator and especially, theirproperties can be directly affected by all eigenvalues in the parameter error differential equation. Fortunately, there exists only one adjusting eigenvalue in the given estimator and then, the parameter convergence rates depend on this minimum eigenvalue. In this note, a new result to determine the minimum eigenvalue is proposed. Under the assumption that the input has as many spectral lines as the number of parameter estimates, it can be proven that the minimum eigenvalue converges to a constant value, which is a function of the forgetting factor and the parameter estimates number.

• Interaction and multiscale mechanics
• /
• v.3 no.2
• /
• pp.123-143
• /
• 2010

The essential idea of the element-free Galerkin method (EFG) is that moving least-squares (MLS) approximation are used for the trial and test functions with the variational principle (weak form). By using the weighted orthogonal basis function to construct the MLS interpolants, we derive the formulae for an improved element-free Galerkin (IEFG) method for solving three-dimensional problems in linear elasticity. There are fewer coefficients in improved moving least-squares (IMLS) approximation than in MLS approximation. Also fewer nodes are selected in the entire domain with the IEFG method than is the case with the conventional EFG method. In this paper, we selected a few example problems to demonstrate the applicability of the method.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.24 no.2
• /
• pp.219-224
• /
• 2020

Binary classification has been broadly investigated in machine learning. In addition, binary classification can be easily extended to multi class problems. To successfully utilize machine learning methods for classification tasks, preprocessing and feature extraction steps are essential. These are important steps to improve their classification performances. In this paper, we propose a new learning method based on weighted least squares. In the weighted least squares, designing weights has a significant role. Due to this necessity, we also propose a new technique to obtain weights that can achieve feature transformation. Based on this weighting technique, we also propose a method to combine the learning and feature extraction processes together to perform both processes simultaneously in one step. The proposed method shows the promising performance on five UCI machine learning data sets.

• Journal of the Korean Data and Information Science Society
• /
• v.25 no.4
• /
• pp.931-939
• /
• 2014

In this paper we propose the iteratively reweighted least squares procedure to solve the quadratic programming problem of support vector expectile regression with an asymmetrically weighted squares loss function. The proposed procedure enables us to select the appropriate hyperparameters easily by using the generalized cross validation function. Through numerical studies on the artificial and the real data sets we show the effectiveness of the proposed method on the estimation performances.

• Industrial Engineering and Management Systems
• /
• v.9 no.3
• /
• pp.262-274
• /
• 2010

This article investigates how to adaptively predict the time-varying metrology delay that could realistically occur in the semiconductor manufacturing practice. Metrology delays pose a great challenge for the existing run-to-run (R2R) controllers, driving the process output significantly away from target if not adequately predicted. First, the expected asymptotic double exponentially weighted moving average (DEWMA) control output, by using the EWMA and recursive least squares (RLS) prediction methods, is derived. It has been found that the relationships between the expected control output and target in both estimation methods are parallel, and six cases are addressed. Within the context of time-varying metrology delay, this paper presents a modified recursive least squares-linear trend (RLS-LT) controller, in combination with runs test. Simulated single input-single output (SISO) R2R processes subject to various time-varying metrology delay scenarios are used as a testbed to evaluate the proposed algorithms. The simulation results indicate that the modified RLS-LT controller can yield the process output more accurately on target with smaller mean squared error (MSE) than the original RLSLT controller that only deals with constant metrology delays.

• The Korean Journal of Nuclear Medicine
• /
• v.37 no.5
• /
• pp.288-300
• /
• 2003

Purpose: To obtain regional blood flow and tissue-blood partition coefficient with time-activity curves from ${H_2}^{15}O$ PET, fitting of some parameters in the Kety model is conventionally accomplished by nonlinear least squares (NLS) analysis. However, NLS requires considerable compuation time then is impractical for pixel-by-pixel analysis to generate parametric images of these parameters. In this study, we investigated several fast parameter estimation methods for the parametric image generation and compared their statistical reliability and computational efficiency. Materials and Methods: These methods included linear least squres (LLS), linear weighted least squares (LWLS), linear generalized least squares (GLS), linear generalized weighted least squares (GWLS), weighted Integration (WI), and model-based clustering method (CAKS). ${H_2}^{15}O$ dynamic brain PET with Poisson noise component was simulated using numerical Zubal brain phantom. Error and bias in the estimation of rCBF and partition coefficient, and computation time in various noise environments was estimated and compared. In audition, parametric images from ${H_2}^{15}O$ dynamic brain PET data peformed on 16 healthy volunteers under various physiological conditions was compared to examine the utility of these methods for real human data. Results: These fast algorithms produced parametric images with similar image qualify and statistical reliability. When CAKS and LLS methods were used combinedly, computation time was significantly reduced and less than 30 seconds for $128{\times}128{\times}46$ images on Pentium III processor. Conclusion: Parametric images of rCBF and partition coefficient with good statistical properties can be generated with short computation time which is acceptable in clinical situation.

• Proceedings of the KIEE Conference
• /
• 2007.07a
• /
• pp.1640-1641
• /
• 2007

In this paper, an experiment of weighted robust least squares frequency estimation for the Gaussian envelope chirp signal which is used in the time-frequency domain reflectometry system was carried out. By incorporating the forgetting factor to the frequency estimator, the weighted robust least squares filter achieved good enough frequency estimation performance for the chirp signal and it can be adopted to implement not only low cost time-frequency domain reflectometry but also real-time time-frequency domain reflectometry implementation.

• Proceedings of the KIEE Conference
• /
• 1991.07a
• /
• pp.691-694
• /
• 1991

In a discrete parameter estimation system, the standard least squares method shows slow convergence. On the other hand, the weighted least squares method has relatively fast convergence. However, if the input is not sufficiently rich, then gain matrix grows unboundedly. In order to solve these problems, this paper proposes a modified least squares algorithm which prevents gain matrix from growing unboundedly and has fast convergence.

• Journal of the Korean Data and Information Science Society
• /
• v.17 no.2
• /
• pp.401-409
• /
• 2006

We consider a generalized partly-parametric additive risk model which generalizes the partly parametric additive risk model suggested by McKeague and Sasieni (1994). As an estimation method of this model, we propose to use the weighted least square estimation, suggested by Huffer and McKeague (1991), for Aalen's additive risk model by a piecewise constant risk. We provide an illustrative example as well as a simulation study that compares the performance of our method with the ordinary least squares method.