Adaptive System Identification Using an Efficient Recursive Total Least Squares Algorithm

  • Choi, Nakjin (School of Electrical Engineering, Seoul National University) ;
  • Lim, Jun-Seok (Department of Electronics Engineering, Sejong University) ;
  • Song, Joon-Il (School of Electrical Engineering, Seoul National University) ;
  • Sung, Koeng-Mo (School of Electrical Engineering, Seoul National University)
  • Published : 2003.09.01

Abstract

We present a recursive total least squares (RTLS) algorithm for adaptive system identification. So far, recursive least squares (RLS) has been successfully applied in solving adaptive system identification problem. But, when input data contain additive noise, the results from RLS could be biased. Such biased results can be avoided by using the recursive total least squares (RTLS) algorithm. The RTLS algorithm described in this paper gives better performance than RLS algorithm over a wide range of SNRs and involves approximately the same computational complexity of O(N²).

Keywords

References

  1. S. Haykin, Adaptive Filter Theory,$4^t^h$ Ed, Prentice-Hall, 2002
  2. G. H. Golub and C. F. Van Loan, 'An analysis of the total least squares problem,' SIAM J. Numer. Anal., 17 (6), 883-893, Dec. 1980 https://doi.org/10.1137/0717073
  3. K. Pearson, 'On lines and planes of closest fit to points in space,' Phil. Mag., 2, 559-572, 1901 https://doi.org/10.1080/14786440109462720
  4. A. Cichocki and S. I. Amari, Adaptive Blind Signal and Image Processing, John Wiley & Sons, 2002
  5. C. E. Davila, 'An efficient recursive total least squares algorithm for FIR adaptive filtering,' IEEE Transactions on Signal Processing, 42 (2), 268-280, 1994 https://doi.org/10.1109/78.275601
  6. A. Cichocki, R. Unbehauen, 'Simplified neural networks for solving linear least squares and total least squares problems in real time,' IEEE Transactions on Neural Networks, 5 (6), 910-923, 1994 https://doi.org/10.1109/72.329687
  7. K. Gao, M. O. Ahmad, and M. N. S. Swamy, 'A constrained anti-Hebbian learning algorithm for total least-squares estimation with applications to adaptive FIR and IIR filtering,' IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing, 41 (11), 718-729, 1994 https://doi.org/10.1109/82.331542
  8. W. Chen, M. Chen and J. Zhou, 'Adaptively regularized constrained total least-squares image restoration,' IEEE Transactions on Image Processing, 9 (4), 588-596, 2000 https://doi.org/10.1109/83.841936