• Title/Summary/Keyword: least squares

Search Result 2,603, Processing Time 0.029 seconds

Weighted Least Squares Based on Feature Transformation using Distance Computation for Binary Classification (이진 분류를 위하여 거리계산을 이용한 특징 변환 기반의 가중된 최소 자승법)

  • Jang, Se-In;Park, Choong-Shik
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.24 no.2
    • /
    • pp.219-224
    • /
    • 2020
  • Binary classification has been broadly investigated in machine learning. In addition, binary classification can be easily extended to multi class problems. To successfully utilize machine learning methods for classification tasks, preprocessing and feature extraction steps are essential. These are important steps to improve their classification performances. In this paper, we propose a new learning method based on weighted least squares. In the weighted least squares, designing weights has a significant role. Due to this necessity, we also propose a new technique to obtain weights that can achieve feature transformation. Based on this weighting technique, we also propose a method to combine the learning and feature extraction processes together to perform both processes simultaneously in one step. The proposed method shows the promising performance on five UCI machine learning data sets.

Automatic Selection of Optimal Parameter for Baseline Correction using Asymmetrically Reweighted Penalized Least Squares (Asymmetrically Reweighted Penalized Least Squares을 이용한 기준선 보정에서 최적 매개변수 자동 선택 방법)

  • Park, Aaron;Baek, Sung-June;Park, Jun-Qyu;Seo, Yu-Gyung;Won, Yonggwan
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.53 no.3
    • /
    • pp.124-131
    • /
    • 2016
  • Baseline correction is very important due to influence on performance of spectral analysis in application of spectroscopy. Baseline is often estimated by parameter selection using visual inspection on analyte spectrum. It is a highly subjective procedure and can be tedious work especially with a large number of data. For these reasons, it is an objective and automatic procedure is necessary to select optimal parameter value for baseline correction. Asymmetrically reweighted penalized least squares (arPLS) based on penalized least squares was proposed for baseline correction in our previous study. The method uses a new weighting scheme based on the generalized logistic function. In this study, we present an automatic selection of optimal parameter for baseline correction using arPLS. The method computes fitness and smoothness values of fitted baseline within available range of parameters and then selects optimal parameter when the sum of normalized fitness and smoothness gets minimum. According to the experimental results using simulated data with varying baselines, sloping, curved and doubly curved baseline, and real Raman spectra, we confirmed that the proposed method can be effectively applied to optimal parameter selection for baseline correction using arPLS.

AN ALGORITHM FOR FITTING OF SPHERES

  • Kim, Ik-Sung
    • The Pure and Applied Mathematics
    • /
    • v.11 no.1
    • /
    • pp.37-49
    • /
    • 2004
  • We are interested in the problem of fitting a sphere to a set of data points in the three dimensional Euclidean space. In Spath [6] a descent algorithm already have been given to find the sphere of best fit in least squares sense of minimizing the orthogonal distances to the given data points. In this paper we present another new algorithm which computes a parametric represented sphere in order to minimize the sum of the squares of the distances to the given points. For any choice of initial approximations our algorithm has the advantage of ensuring convergence to a local minimum. Numerical examples are given.

  • PDF

Application of Recursive Least Squares Method to Estimate Rail Irregularities from an Inertial Measurement Unit on a Bogie (대차 관성측정 장치에서 궤도틀림 추정을 위한 반복 최소자승법의 적용)

  • Lee, Jun-Seok;Choi, Sung-Hoon;Kim, Sang-Soo;Park, Choon-Soo
    • Proceedings of the KSR Conference
    • /
    • 2011.05a
    • /
    • pp.427-434
    • /
    • 2011
  • This paper is focused on application of recursive least squares method to estimate rail irregularities from the acceleration measurement on an axle-box or a bogie for the rail condition monitoring with in-service high-speed trains. Generally, the rail condition was monitored by a special railway inspection vehicle but the monitoring method needs an expensive measurement system. A monitoring method using accelerometers on an axle-box or a bogie was already proposed in the previous study, and the displacement was successfully estimated from the acceleration data by using Kalman and frequency selective band-pass filters. However, it was found that the displacement included not only the rail irregularities but also phase delay of the applied filters, and effect of suspension of the bogie and conicity of the wheel. To identify the rail irregularities from the estimated displacement, a compensation filter method is proposed. The compensation filters are derived by using recursive least squares method with the estimated displacement as input and the measured rail irregularity as output. The estimated rail irregularities are compared with the true rail irregularity data from the rail inspection system. From the comparison, the proposed method is a useful tool for the measurement of lateral and vertical rail irregularity.

  • PDF

Non-linear Characteristic Modeling of Frictional Suspension Using Measured Data (특성 시험 결과를 이용한 마찰 서스펜션의 비선형 특성 모델링)

  • Yoon, Chang Gyu;Jang, Jin Seok;Jin, Jae Hoon;Yoo, Wan Suk
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.39 no.1
    • /
    • pp.45-53
    • /
    • 2015
  • Large-capacity of household washing machine can become unbalanced during the dehydration process. To solve this problem, several types of suspensions have been installed in a washing machine. In this study, physical tests were carried out on a frictional suspension, and the nonlinear characteristics were modeled by combining several simple physical models. The parameters were estimated based on the least squares solution. The simulation and test results were compared to verify the validity of the friction damper model.

Least Squares Based PID Control of an Electromagnetic Suspension System

  • Park, Yon-Mook;Nam, Myeong-Ryong;Seo, In-Ho;Lee, Sang-Hyun;Lim, Jong-Tae;Tahk, Min-Jea
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.2252-2257
    • /
    • 2003
  • In this paper, we develop the so-called functional test model for magnetic bearing reaction wheels. The functional test model has three degree of freedom, which consists of one axial suspension from gravity and the other two axes gimbaling capability to small angle, and does not include the motor. For the control of the functional test model, we derive the optimal electromagnetic forces based on the least squares method, and use the proportional-integral-derivative controller. Then, we develop a hardware setup, which mainly consists of the digital signal processor and the 12-bit analog-to-digital and digital-to-analog converters, and show the experimental results.

  • PDF

L1 norm-recursive least squares algorithm for the robust sparse acoustic communication channel estimation (희소성 음향 통신 채널 추정 견실화를 위한 백색화를 적용한 l1놈-RLS 알고리즘)

  • Lim, Jun-Seok;Pyeon, Yong-Gook;Kim, Sungil
    • The Journal of the Acoustical Society of Korea
    • /
    • v.39 no.1
    • /
    • pp.32-37
    • /
    • 2020
  • This paper proposes a new l1-norm-Recursive Least Squares (RLS) algorithm which is numerically more robust than the conventional l1-norm-RLS. The l1-norm-RLS was proposed by Eksioglu and Tanc in order to estimate the sparse acoustic channel. However the algorithm has numerical instability in the inverse matrix calculation. In this paper, we propose a new algorithm which is robust against the numerical instability. We show that the proposed method improves stability under several numerically erroneous situations.

Moving Least Squares Interface Welding Method for Coupled Analysis of Independently Modeled Finite Element Substructures (독립적으로 모델링된 유한요소 부분구조물 시스템의 통합 연계해석을 위한 이동최소자승 정계접합법의 개발)

  • An, Jae-Mo;Song, You-Me;Choi, Dong-Whan;Cho, Jin-Yeon
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.33 no.10
    • /
    • pp.26-34
    • /
    • 2005
  • In this paper, a novel moving least squares interface welding method is proposed to carry out the coupled analysis of whole model composed of independently modeled finite element substructures with nodal mismatching interfaces. To verify the validity, and efficiency of the proposed interface welding method, various numerical examples are worked out including patch tests, convergence tests, and examples of coupled analyses of the structural systems with mismatching substructures. From the numerical tests, it is confirmed that one can efficiently carry out the coupled analysis of whole model composed of mismatching finite element substructures through the proposed method without any remeshing or any additional unknown.

A PRECONDITIONER FOR THE LSQR ALGORITHM

  • Karimi, Saeed;Salkuyeh, Davod Khojasteh;Toutounian, Faezeh
    • Journal of applied mathematics & informatics
    • /
    • v.26 no.1_2
    • /
    • pp.213-222
    • /
    • 2008
  • Iterative methods are often suitable for solving least squares problems min$||Ax-b||_2$, where A $\epsilon\;\mathbb{R}^{m{\times}n}$ is large and sparse. The well known LSQR algorithm is among the iterative methods for solving these problems. A good preconditioner is often needed to speedup the LSQR convergence. In this paper we present the numerical experiments of applying a well known preconditioner for the LSQR algorithm. The preconditioner is based on the $A^T$ A-orthogonalization process which furnishes an incomplete upper-lower factorization of the inverse of the normal matrix $A^T$ A. The main advantage of this preconditioner is that we apply only one of the factors as a right preconditioner for the LSQR algorithm applied to the least squares problem min$||Ax-b||_2$. The preconditioner needs only the sparse matrix-vector product operations and significantly reduces the solution time compared to the unpreconditioned iteration. Finally, some numerical experiments on test matrices from Harwell-Boeing collection are presented to show the robustness and efficiency of this preconditioner.

  • PDF

Location of Acoustic Emission Sources in a PSC Beam using Least Squares (최소제곱법에 의한 PSC보의 음향방출파원 위치결정)

  • Lee Chang-No
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.24 no.3
    • /
    • pp.271-279
    • /
    • 2006
  • Acoustic Emission (AE) technology is an effective nondestructive testing for continuous monitoring of defect formation and failures in structural materials. This paper presents a source location model using Acoustic Emission (AE) sensors in a Pre-Stressed Concrete (PSC) beam and the evaluation of the model was performed through lab experiments. 54 AE events were made on the surface of the 5m-PSC beam using a Schmidt Hammer and arrival times were measured with 7AE sensors. The source location f3r each event was estimated using least squares. The results were compared with actual positions and the RMSE (Root Mean Square Errors) was about 2cm.