• Title/Summary/Keyword: recursive least squares (RLS)

Search Result 69, Processing Time 0.028 seconds

Adaptive System Identification Using an Efficient Recursive Total Least Squares Algorithm

  • Choi, Nakjin;Lim, Jun-Seok;Song, Joon-Il;Sung, Koeng-Mo
    • The Journal of the Acoustical Society of Korea
    • /
    • v.22 no.3E
    • /
    • pp.93-100
    • /
    • 2003
  • We present a recursive total least squares (RTLS) algorithm for adaptive system identification. So far, recursive least squares (RLS) has been successfully applied in solving adaptive system identification problem. But, when input data contain additive noise, the results from RLS could be biased. Such biased results can be avoided by using the recursive total least squares (RTLS) algorithm. The RTLS algorithm described in this paper gives better performance than RLS algorithm over a wide range of SNRs and involves approximately the same computational complexity of O(N²).

FIR System Identification Method Using Collaboration Between RLS (Recursive Least Squares) and RTLS (Recursive Total Least Squares) (RLS (Recursive Least Squares)와 RTLS (Recursive Total Least Squares)의 결합을 이용한 새로운 FIR 시스템 인식 방법)

  • Lim, Jun-Seok;Pyeon, Yong-Gook
    • The Journal of the Acoustical Society of Korea
    • /
    • v.29 no.6
    • /
    • pp.374-380
    • /
    • 2010
  • It is known that the problem of FIR filtering with noisy input and output data can be solved by a total least squares (TLS) estimation. It is also known that the performance of the TLS estimation is very sensitive to the ratio between the variances of the input and output noises. In this paper, we propose a convex combination algorithm between the ordinary recursive LS based TLS (RTLS) and the ordinary recursive LS (RLS). This combined algorithm is robust to the noise variance ratio and has almost the same complexity as the RTLS. Simulation results show that the proposed algorithm performs near TLS in noise variance ratio ${\gamma}{\approx}1$ and that it outperforms TLS and LS in the rage of 2 < $\gamma$ < 20. Consequently, the practical workability of the TLS method applied to noisy data has been significantly broadened.

An Efficient Recursive Total Least Squares Algorithm for Training Multilayer Feedforward Neural Networks

  • Choi Nakjin;Lim Jun-Seok;Sung Koeng-Mo
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • autumn
    • /
    • pp.527-530
    • /
    • 2004
  • We present a recursive total least squares (RTLS) algorithm for multilayer feedforward neural networks. So far, recursive least squares (RLS) has been successfully applied to training multilayer feedforward neural networks. But, when input data contain additive noise, the results from RLS could be biased. Such biased results can be avoided by using the recursive total least squares (RTLS) algorithm. The RTLS algorithm described in this paper gives better performance than RLS algorithm over a wide range of SNRs and involves approximately the same computational complexity of $O(N^{2})$.

  • PDF

Adaptive Inverse Modelling of Noisy System by Total Least Squares (완전최소자승법을 이용한 잡음환경하에서 시스템의 적응 역 모델링)

  • 황재섭
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • 1991.06a
    • /
    • pp.23-27
    • /
    • 1991
  • RLS(Recursive Least Squares)나 LMS(Least mean square)등은 알고리듬 고유의 성질상 잡음이 섞인 시스템에 있어서는 올바른 역 모델링을 할 수 없다. 따라서, 잡음의 영향을 받지않는 견실한(robust) 모델 추정 알고리듬이 필요하다. 본 논문에서는 잡음환경하에 있는 시스템을역 모델링하는데 있어서, 잡음의 영향을 줄이기위해 완전최소자승법을 도입하고 기존의 최소자승법과 비교 실험하였다. 그리고, 이 방법의 적응 알고리듬을 제안하였으며, RLS(Recursive least squares)와 그 성능을 비교하여 타당성을 검토하였다.

  • PDF

Recursive Least Squares Run-to-Run Control with Time-Varying Metrology Delays

  • Fan, Shu-Kai;Chang, Yuan-Jung
    • Industrial Engineering and Management Systems
    • /
    • v.9 no.3
    • /
    • pp.262-274
    • /
    • 2010
  • This article investigates how to adaptively predict the time-varying metrology delay that could realistically occur in the semiconductor manufacturing practice. Metrology delays pose a great challenge for the existing run-to-run (R2R) controllers, driving the process output significantly away from target if not adequately predicted. First, the expected asymptotic double exponentially weighted moving average (DEWMA) control output, by using the EWMA and recursive least squares (RLS) prediction methods, is derived. It has been found that the relationships between the expected control output and target in both estimation methods are parallel, and six cases are addressed. Within the context of time-varying metrology delay, this paper presents a modified recursive least squares-linear trend (RLS-LT) controller, in combination with runs test. Simulated single input-single output (SISO) R2R processes subject to various time-varying metrology delay scenarios are used as a testbed to evaluate the proposed algorithms. The simulation results indicate that the modified RLS-LT controller can yield the process output more accurately on target with smaller mean squared error (MSE) than the original RLSLT controller that only deals with constant metrology delays.

Blind Channel Estimator based on the RLS algorithm (RLS 알고리즘에 기반을 둔 블라인드 채널 추정)

  • 서우정;하판봉;윤태성
    • Proceedings of the IEEK Conference
    • /
    • 1999.11a
    • /
    • pp.655-658
    • /
    • 1999
  • In this study, We derived Recursive Least Squares(RLS) algorithm with adaptive maximum -likelihood channel estimate for digital pulse amplitude modulated sequence in the presence of intersymbol interference and additive white Gaussian noise. RLS algorithms have better convergence characteristics than conventional algorithms, LMS Least Mean Squares) algorithms.

  • PDF

A New Recursive Least-Squares Algorithm based on Matrix Pseudo Inverses (ICCAS 2003)

  • Quan, Zhonghua;Han, Soo-Hee;Kwon, Wook-Hyun
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.927-931
    • /
    • 2003
  • In this paper, a new Recursive Least-Squares(RLS) algorithm based on matrix pseudo-inverses is presented. The aim is to use the proposed new RLS algorithm for not only the over-determined but also the under-determined estimation problem. Compared with previous results, e.g., Jie Zhou et al., the derivation of the proposed recursive form is much easier, and the recursion form is also much simpler. Furthermore, it is shown by simulations that the proposed RLS algorithm is more efficient and numerically stable than the existing algorithms.

  • PDF

L1 norm-recursive least squares algorithm for the robust sparse acoustic communication channel estimation (희소성 음향 통신 채널 추정 견실화를 위한 백색화를 적용한 l1놈-RLS 알고리즘)

  • Lim, Jun-Seok;Pyeon, Yong-Gook;Kim, Sungil
    • The Journal of the Acoustical Society of Korea
    • /
    • v.39 no.1
    • /
    • pp.32-37
    • /
    • 2020
  • This paper proposes a new l1-norm-Recursive Least Squares (RLS) algorithm which is numerically more robust than the conventional l1-norm-RLS. The l1-norm-RLS was proposed by Eksioglu and Tanc in order to estimate the sparse acoustic channel. However the algorithm has numerical instability in the inverse matrix calculation. In this paper, we propose a new algorithm which is robust against the numerical instability. We show that the proposed method improves stability under several numerically erroneous situations.

An time-varying acoustic channel estimation using least squares algorithm with an average gradient vector based a self-adjusted step size and variable forgetting factor (기울기 평균 벡터를 사용한 가변 스텝 최소 자승 알고리즘과 시변 망각 인자를 사용한 시변 음향 채널 추정)

  • Lim, Jun-Seok
    • The Journal of the Acoustical Society of Korea
    • /
    • v.38 no.3
    • /
    • pp.283-289
    • /
    • 2019
  • RLS (Recursive-least-squares) algorithm is known to have good convergence and excellent error level after convergence. However, there is a disadvantage that numerical instability is included in the algorithm due to inverse matrix calculation. In this paper, we propose an algorithm with no matrix inversion to avoid the instability aforementioned. The proposed algorithm still keeps the same convergence performance. In the proposed algorithm, we adopt an averaged gradient-based step size as a self-adjusted step size. In addition, a variable forgetting factor is introduced to provide superior performance for time-varying channel estimation. Through simulations, we compare performance with conventional RLS and show its equivalency. It also shows the merit of the variable forgetting factor in time-varying channels.

Interference Cancellation Based on Adaptive Signal Processing for MIMO RF Repeaters (MIMO RF 중계기를 위한 적응 신호처리 기반의 간섭 제거)

  • Lee, Kyu-Bum;Choi, Ji-Hoon
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.35 no.9C
    • /
    • pp.735-742
    • /
    • 2010
  • In this paper, we propose adaptive algorithms for interference cancellation in RF repeaters with multiple transmit and receive antennas. When multiple antennas are used in a repeater, the imperfect isolation between transmit and receive antennas causes the feedback interference which is modeled as multi-input multi-output (MIMO) channel. To remove the feedback interference, we derive the least mean square (LMS) algorithm and the recursive least squares (RLS) algorithm for interference cancellation based on adaptive signal processing techniques. Through computer simulations for the proposed algorithms, we analyze the convergence characteristics and compare the steady-state performance for interference cancellation.