• Title/Summary/Keyword: Least-square algorithm

Search Result 892, Processing Time 0.024 seconds

Variable Step LMS Algorithm using Fibonacci Sequence (피보나치 수열을 활용한 가변스텝 LMS 알고리즘)

  • Woo, Hong-Chae
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.19 no.2
    • /
    • pp.42-46
    • /
    • 2018
  • Adaptive signal processing is quite important in various signal and communication environments. In adaptive signal processing methods since the least mean square(LMS) algorithm is simple and robust, it is used everywhere. As the step is varied in the variable step(VS) LMS algorithm, the fast convergence speed and the small excess mean square error can be obtained. Various variable step LMS algorithms are researched for better performances. But in some of variable step LMS algorithms the computational complexity is quite large for better performances. The fixed step LMS algorithm with a low computational complexity merit and the variable step LMS algorithm with a fast convergence merit are combined in the proposed sporadic step algorithm. As the step is sporadically updated, the performances of the variable step LMS algorithm can be maintained in the low update rate using Fibonacci sequence. The performances of the proposed variable step LMS algorithm are proved in the adaptive equalizer.

A Walsh-Hadamard Transform Adaptive Filter with Time-varying Step Size (가변 스텝사이즈를 적용한 월시.아다말 적응필터)

  • 오신범;이채욱
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.5 no.2
    • /
    • pp.32-38
    • /
    • 2000
  • One of the most popular algorithm in adaptive signal processing is the least mean square(LMS) algorithm. The majority of these papers examine the LMS algorithm with a constant step size. The choice of the step size reflects a tradeoff between misadjustment and the speed of adaptation. Subsequent works have discussed the issue of optimization of the step size or methods of varying the step size to improve performance. However there is as yet no detailed analysis of a variable step size algorithm that is capable of giving both the adaptation speed and the convergence. In this paper we propose a new variable step size algorithm where the step size adjustment is controlled by the gradient of error square. The proposed algorithm is performed in the Walsh-Hadamard domain in real-valued orthogonal transform because of fast convergence. The simulation results using the new algorithm for noise canceller system is described. They are compared to the results obtained by other algorithms. It is shown that the proposed algorithm produces good results compared with conventional algorithms.

  • PDF

On the Behavior of the Signed Regressor Least Mean Squares Adaptation with Gaussian Inputs (가우시안 입력신호에 대한 Signed Regressor 최소 평균자승 적응 방식의 동작 특성)

  • 조성호
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.18 no.7
    • /
    • pp.1028-1035
    • /
    • 1993
  • The signed regressor (SR) algorithm employs one bit quantization on the input regressor (or tap input) in such a way that the quantized input sequences become +1 or -1. The algorithm is computationally more efficient by nature than the popular least mean square (LMS) algorithm. The behavior of the SR algorithm unfortunately is heavily dependent on the characteristics of the input signal, and there are some Inputs for which the SR algorithm becomes unstable. It is known, however, that such a stability problem does not take place with the SR algorithm when the input signal is Gaussian, such as in the case of speech processing. In this paper, we explore a statistical analysis of the SR algorithm. Under the assumption that signals involved are zero-mean and Gaussian, and further employing the commonly used independence assumption, we derive a set of nonlinear evolution equations that characterizes the mean and mean-squared behavior of the SR algorithm. Experimental results that show very good agreement with our theoretical derivations are also presented.

  • PDF

Secondary Path Estimation Algorithm Based on Residual Music Canceller for Noise Cancelling Headphone (노이즈 캔슬링 헤드폰에 적합한 잔여 음악 제거기 기반의 2차 경로 추정 알고리즘)

  • Ji, Youna;Lee, Keunsang;Park, Youngcheol
    • The Journal of the Acoustical Society of Korea
    • /
    • v.34 no.5
    • /
    • pp.377-384
    • /
    • 2015
  • An active noise control (ANC) algorithm for noise canceling headphone is proposed. In this study, the feedback ANC operated with the filtered-x least mean square algorithm (FxLMS) algorithm is used to attenuate the undesired noise. Also an adaptive residual music canceller (RMC) is proposed for enhancing the accuracy of the reference signal of the feedback ANC. Simulation results show that a high quality of music sound can be consistently achieved in a time-varying secondary path situation.

K-Means-Based Polynomial-Radial Basis Function Neural Network Using Space Search Algorithm: Design and Comparative Studies (공간 탐색 최적화 알고리즘을 이용한 K-Means 클러스터링 기반 다항식 방사형 기저 함수 신경회로망: 설계 및 비교 해석)

  • Kim, Wook-Dong;Oh, Sung-Kwun
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.17 no.8
    • /
    • pp.731-738
    • /
    • 2011
  • In this paper, we introduce an advanced architecture of K-Means clustering-based polynomial Radial Basis Function Neural Networks (p-RBFNNs) designed with the aid of SSOA (Space Search Optimization Algorithm) and develop a comprehensive design methodology supporting their construction. In order to design the optimized p-RBFNNs, a center value of each receptive field is determined by running the K-Means clustering algorithm and then the center value and the width of the corresponding receptive field are optimized through SSOA. The connections (weights) of the proposed p-RBFNNs are of functional character and are realized by considering three types of polynomials. In addition, a WLSE (Weighted Least Square Estimation) is used to estimate the coefficients of polynomials (serving as functional connections of the network) of each node from output node. Therefore, a local learning capability and an interpretability of the proposed model are improved. The proposed model is illustrated with the use of nonlinear function, NOx called Machine Learning dataset. A comparative analysis reveals that the proposed model exhibits higher accuracy and superb predictive capability in comparison to some previous models available in the literature.

Learning Behaviors of Stochastic Gradient Radial Basis Function Network Algorithms for Odor Sensing Systems

  • Kim, Nam-Yong;Byun, Hyung-Gi;Kwon, Ki-Hyeon
    • ETRI Journal
    • /
    • v.28 no.1
    • /
    • pp.59-66
    • /
    • 2006
  • Learning behaviors of a radial basis function network (RBFN) using a singular value decomposition (SVD) and stochastic gradient (SG) algorithm, together named RBF-SVD-SG, for odor sensing systems are analyzed, and a fast training method is proposed. RBF input data is from a conducting polymer sensor array. It is revealed in this paper that the SG algorithm for the fine-tuning of centers and widths still shows ill-behaving learning results when a sufficiently small convergence coefficient is not used. Since the tuning of centers in RBFN plays a dominant role in the performance of RBFN odor sensing systems, our analysis is focused on the center-gradient variance of the RBFN-SVD-SG algorithm. We found analytically that the steadystate weight fluctuation and large values of a convergence coefficient can lead to an increase in variance of the center-gradient estimate. Based on this analysis, we propose to use the least mean square algorithm instead of SVD in adjusting the weight for stable steady-state weight behavior. Experimental results of the proposed algorithm have shown faster learning speed and better classification performance.

  • PDF

Simple closed-form solution for a single source estimation in mixed far-field and near-field conditions (원근 혼합환경에서 간단한 닫힌 형식을 이용한 단일 음원 위치 추정 기법)

  • Jung, Tae-Jin;Lee, KyunKyung
    • The Journal of the Acoustical Society of Korea
    • /
    • v.35 no.1
    • /
    • pp.35-41
    • /
    • 2016
  • Based on correlation and least square method, a closed-form algorithm for estimating the location of mixed far-field and near-field source is presented using the Uniform Circular Array (UCA). Recently, for a homogeneous circular arrangement case, a correlation based closed-form algorithm is proposed to estimate 2-D angle (azimuth, elevation) and the extended algorithm is proposed to 3-D location (azimuth, elevation, range). These algorithms assume the far-field source or near-field source only. Therefore, for mixed source localization, the proposed algorithm estimates source location with the assumption of far-field source, and then estimates the range to distinguish the far-field from the near-field source. For both cases, numerical experiments have been performed, which confirmed the validity of the proposed algorithm.

Robot Control via RPO-based Reinforcement Learning Algorithm (RPO 기반 강화학습 알고리즘을 이용한 로봇제어)

  • Kim, Jong-Ho;Kang, Dae-Sung;Park, Joo-Young
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.15 no.4
    • /
    • pp.505-510
    • /
    • 2005
  • The RPO(randomized policy optimizer) algorithm, which utilizes probabilistic policy for the action selection, is a recently developed tool in the area of reinforcement learning, and has been shown to be very successful in several application problems. In this paper, we propose a modified RPO algorithm, whose critic network is adapted via RLS(Recursive Least Square) algorithm. In order to illustrate the applicability of the modified RPO method, we applied the modified algorithm to Kimura's robot and observed very good performance. We also developed a MATLAB-based animation program, by which the effectiveness of the training algorithms on the acceleration or the robot movement were observed.

Deterministic Function Variable Step Size LMS Algorithm (결정함수 가변스텝 LMS 알고리즘)

  • Woo, Hong-Chae
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.12 no.2
    • /
    • pp.128-132
    • /
    • 2011
  • Least mean square adaptive algorithms have played important role in radar, sonar, speech processing, and mobile communication. In mobile communication area, the convergence rate of a LMS algorithm is quite important. However, LMS algorithms have slow and non-uniform convergence rate problem For overcoming these shortcomings, various variable step LMS adaptive algorithms have been studied in recent years. Most of these recent LMS algorithms have used complex variable step methods to get a rapid convergence. But complex variable step methods need a high computational complexity. Therefore, the main merits such as the simplicity and the robustness in a LMS algorithm can be eroded. The proposed deterministic variable step LMS algorithm is based upon a simple deterministic function for the step update so that the simplicity of the proposed algorithm is obtained and the fast convergence is still maintainable.

Adaptive Interference Cancellation Using CMA-Correlation Normalized LMS for WCDMA System

  • Han, Yong-Sik;Yang, Woon-Geun
    • Journal of information and communication convergence engineering
    • /
    • v.8 no.2
    • /
    • pp.155-158
    • /
    • 2010
  • In this article, we proposed a new interference canceller using the adaptive algorithm. We designed constant modulus algorithm-correlation normailized least mean square (CMA-CNLMS) for wireless system. This structure is normalized LMS algorithm using correlation between the desired and input signal for cancelling the interference signals in the wideband code division multiple access (WCDMA) system. We showed that the proposed algorithm could improve the Mean Square Error (MSE) performance of LMS algorithm. MATLAB (Matrix Laboratory) is employed to analyze the proposed algorithm and to compare it with the experimental results. The MSE value of the LMS with mu=0.0001 was measured as - 12.5 dB, and that of the proposed algorithm was -19.5 dB which showed an improvement of 7dB.