• Title/Summary/Keyword: Recursive Least Squares (RLS) Algorithm

Search Result 52, Processing Time 0.032 seconds

Adaptive System Identification Using an Efficient Recursive Total Least Squares Algorithm

  • Choi, Nakjin;Lim, Jun-Seok;Song, Joon-Il;Sung, Koeng-Mo
    • The Journal of the Acoustical Society of Korea
    • /
    • v.22 no.3E
    • /
    • pp.93-100
    • /
    • 2003
  • We present a recursive total least squares (RTLS) algorithm for adaptive system identification. So far, recursive least squares (RLS) has been successfully applied in solving adaptive system identification problem. But, when input data contain additive noise, the results from RLS could be biased. Such biased results can be avoided by using the recursive total least squares (RTLS) algorithm. The RTLS algorithm described in this paper gives better performance than RLS algorithm over a wide range of SNRs and involves approximately the same computational complexity of O(N²).

An Efficient Recursive Total Least Squares Algorithm for Training Multilayer Feedforward Neural Networks

  • Choi Nakjin;Lim Jun-Seok;Sung Koeng-Mo
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • autumn
    • /
    • pp.527-530
    • /
    • 2004
  • We present a recursive total least squares (RTLS) algorithm for multilayer feedforward neural networks. So far, recursive least squares (RLS) has been successfully applied to training multilayer feedforward neural networks. But, when input data contain additive noise, the results from RLS could be biased. Such biased results can be avoided by using the recursive total least squares (RTLS) algorithm. The RTLS algorithm described in this paper gives better performance than RLS algorithm over a wide range of SNRs and involves approximately the same computational complexity of $O(N^{2})$.

  • PDF

FIR System Identification Method Using Collaboration Between RLS (Recursive Least Squares) and RTLS (Recursive Total Least Squares) (RLS (Recursive Least Squares)와 RTLS (Recursive Total Least Squares)의 결합을 이용한 새로운 FIR 시스템 인식 방법)

  • Lim, Jun-Seok;Pyeon, Yong-Gook
    • The Journal of the Acoustical Society of Korea
    • /
    • v.29 no.6
    • /
    • pp.374-380
    • /
    • 2010
  • It is known that the problem of FIR filtering with noisy input and output data can be solved by a total least squares (TLS) estimation. It is also known that the performance of the TLS estimation is very sensitive to the ratio between the variances of the input and output noises. In this paper, we propose a convex combination algorithm between the ordinary recursive LS based TLS (RTLS) and the ordinary recursive LS (RLS). This combined algorithm is robust to the noise variance ratio and has almost the same complexity as the RTLS. Simulation results show that the proposed algorithm performs near TLS in noise variance ratio ${\gamma}{\approx}1$ and that it outperforms TLS and LS in the rage of 2 < $\gamma$ < 20. Consequently, the practical workability of the TLS method applied to noisy data has been significantly broadened.

A New Recursive Least-Squares Algorithm based on Matrix Pseudo Inverses (ICCAS 2003)

  • Quan, Zhonghua;Han, Soo-Hee;Kwon, Wook-Hyun
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.927-931
    • /
    • 2003
  • In this paper, a new Recursive Least-Squares(RLS) algorithm based on matrix pseudo-inverses is presented. The aim is to use the proposed new RLS algorithm for not only the over-determined but also the under-determined estimation problem. Compared with previous results, e.g., Jie Zhou et al., the derivation of the proposed recursive form is much easier, and the recursion form is also much simpler. Furthermore, it is shown by simulations that the proposed RLS algorithm is more efficient and numerically stable than the existing algorithms.

  • PDF

Blind Channel Estimator based on the RLS algorithm (RLS 알고리즘에 기반을 둔 블라인드 채널 추정)

  • 서우정;하판봉;윤태성
    • Proceedings of the IEEK Conference
    • /
    • 1999.11a
    • /
    • pp.655-658
    • /
    • 1999
  • In this study, We derived Recursive Least Squares(RLS) algorithm with adaptive maximum -likelihood channel estimate for digital pulse amplitude modulated sequence in the presence of intersymbol interference and additive white Gaussian noise. RLS algorithms have better convergence characteristics than conventional algorithms, LMS Least Mean Squares) algorithms.

  • PDF

An time-varying acoustic channel estimation using least squares algorithm with an average gradient vector based a self-adjusted step size and variable forgetting factor (기울기 평균 벡터를 사용한 가변 스텝 최소 자승 알고리즘과 시변 망각 인자를 사용한 시변 음향 채널 추정)

  • Lim, Jun-Seok
    • The Journal of the Acoustical Society of Korea
    • /
    • v.38 no.3
    • /
    • pp.283-289
    • /
    • 2019
  • RLS (Recursive-least-squares) algorithm is known to have good convergence and excellent error level after convergence. However, there is a disadvantage that numerical instability is included in the algorithm due to inverse matrix calculation. In this paper, we propose an algorithm with no matrix inversion to avoid the instability aforementioned. The proposed algorithm still keeps the same convergence performance. In the proposed algorithm, we adopt an averaged gradient-based step size as a self-adjusted step size. In addition, a variable forgetting factor is introduced to provide superior performance for time-varying channel estimation. Through simulations, we compare performance with conventional RLS and show its equivalency. It also shows the merit of the variable forgetting factor in time-varying channels.

L1 norm-recursive least squares algorithm for the robust sparse acoustic communication channel estimation (희소성 음향 통신 채널 추정 견실화를 위한 백색화를 적용한 l1놈-RLS 알고리즘)

  • Lim, Jun-Seok;Pyeon, Yong-Gook;Kim, Sungil
    • The Journal of the Acoustical Society of Korea
    • /
    • v.39 no.1
    • /
    • pp.32-37
    • /
    • 2020
  • This paper proposes a new l1-norm-Recursive Least Squares (RLS) algorithm which is numerically more robust than the conventional l1-norm-RLS. The l1-norm-RLS was proposed by Eksioglu and Tanc in order to estimate the sparse acoustic channel. However the algorithm has numerical instability in the inverse matrix calculation. In this paper, we propose a new algorithm which is robust against the numerical instability. We show that the proposed method improves stability under several numerically erroneous situations.

Interference Cancellation Based on Adaptive Signal Processing for MIMO RF Repeaters (MIMO RF 중계기를 위한 적응 신호처리 기반의 간섭 제거)

  • Lee, Kyu-Bum;Choi, Ji-Hoon
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.35 no.9C
    • /
    • pp.735-742
    • /
    • 2010
  • In this paper, we propose adaptive algorithms for interference cancellation in RF repeaters with multiple transmit and receive antennas. When multiple antennas are used in a repeater, the imperfect isolation between transmit and receive antennas causes the feedback interference which is modeled as multi-input multi-output (MIMO) channel. To remove the feedback interference, we derive the least mean square (LMS) algorithm and the recursive least squares (RLS) algorithm for interference cancellation based on adaptive signal processing techniques. Through computer simulations for the proposed algorithms, we analyze the convergence characteristics and compare the steady-state performance for interference cancellation.

Two regularization constant selection methods for recursive least squares algorithm with convex regularization and their performance comparison in the sparse acoustic communication channel estimation (볼록 규준화 RLS의 규준화 상수를 정하기 위한 두 가지 방법과 희소성 음향 통신 채널 추정 성능 비교)

  • Lim, Jun-Seok;Hong, Wooyoung
    • The Journal of the Acoustical Society of Korea
    • /
    • v.35 no.5
    • /
    • pp.383-388
    • /
    • 2016
  • We develop two methods to select a constant in the RLS (Recursive Least Squares) with the convex regularization. The RLS with the convex regularization was proposed by Eksioglu and Tanc in order to estimate the sparse acoustic channel. However the algorithm uses the regularization constant which needs the information about the true channel response for the best performance. In this paper, we propose two methods to select the regularization constant which don't need the information about the true channel response. We show that the estimation performance using the proposed methods is comparable with the Eksioglu and Tanc's algorithm.

Low-Complexity VFF-RLS Algorithm Using Normalization Technique (정규화 기법을 이용한 낮은 연산량의 가변 망각 인자 RLS 기법)

  • Lee, Seok-Jin;Lim, Jun-Seok;Sung, Koeng-Mo
    • The Journal of the Acoustical Society of Korea
    • /
    • v.29 no.1
    • /
    • pp.18-23
    • /
    • 2010
  • The RLS (Recursive Least Squares) method is a broadly used adaptive algorithm for signal processing in electronic engineering. The RLS algorithm shows a good performance and a fast adaptation within a stationary environment, but it shows a Poor performance within a non-stationary environment because the method has a fixed forgetting factor. In order to enhance 'tracking' performances, BLS methods with an adaptive forgetting factor had been developed. This method shows a good tracking performance, however, it suffers from heavy computational loads. Therefore, we propose a modified AFF-RLS which has relatively low complexity m this paper.