• Title/Summary/Keyword: RLS method

Search Result 141, Processing Time 0.038 seconds

Control of Crawling Robot using Actor-Critic Fuzzy Reinforcement Learning (액터-크리틱 퍼지 강화학습을 이용한 기는 로봇의 제어)

  • Moon, Young-Joon;Lee, Jae-Hoon;Park, Joo-Young
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.19 no.4
    • /
    • pp.519-524
    • /
    • 2009
  • Recently, reinforcement learning methods have drawn much interests in the area of machine learning. Dominant approaches in researches for the reinforcement learning include the value-function approach, the policy search approach, and the actor-critic approach, among which pertinent to this paper are algorithms studied for problems with continuous states and continuous actions along the line of the actor-critic strategy. In particular, this paper focuses on presenting a method combining the so-called ACFRL(actor-critic fuzzy reinforcement learning), which is an actor-critic type reinforcement learning based on fuzzy theory, together with the RLS-NAC which is based on the RLS filters and natural actor-critic methods. The presented method is applied to a control problem for crawling robots, and some results are reported from comparison of learning performance.

Performance Characteristics of Decision Feedback Equalizer Model by Feedback Running RLS algorithm for Mobile Communications (피드백러닝 RLS알고리즘에 의한 이동통신용 판정귀환형 등화기모델의 동작 특성)

  • 이우재;이종룡;주창복
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.2 no.1
    • /
    • pp.45-51
    • /
    • 1998
  • In the realization of a high speed digital transmission over several tens kbps in mobile communications, it follow delay distortion on a count of transmission path variation by multipath interference waves. Therefore it is inevitably necessary to establish the techniques overcoming the frequency selective fading. In this paper, a feedback running RLS algorithm which is improved the RLS algorithm using exponential weighting factor, is proposed for the control algorithm of DFE and by the computer simulation method, and the performance characteristics of DFE is analyzed for the one-ray and two-ray waves model under the random Gaussian noise. The computer simulation results of proposed RLS algorithm for the $\pi$/4QPSK signal with one symbol time delayed interference signal of S/I = 20[dB], under the S/N = 10[dB] with $\lambda$= 0.9 showed excellent following characteristics and equalization characteristics.

  • PDF

Acupuncture Treatment for Restless Legs Syndrome: A Review of Randomized Controlled Trials

  • Go Eun Chae;Hyun Woo Kim;Hye Jeong Jo;Ahra Koh;Young Jin Lee;Ji Eun Choi;Woo Young Kim
    • Journal of Acupuncture Research
    • /
    • v.40 no.4
    • /
    • pp.308-318
    • /
    • 2023
  • To determine the effectiveness of acupuncture in treating restless legs syndrome (RLS), we conducted a literature review of randomized controlled trials (RCTs) that utilized acupuncture as an intervention for patients diagnosed with RLS. Relevant clinical studies (n = 158) from seven databases (the Cochrane Library, PubMed, Embase, CNKI, KISS, RISS, and OASIS) were included based on the inclusion and exclusion criteria and analyzed. Moreover, 6 RCTs were selected for review. In all six studies, it was indicated people who underwent acupuncture treatment showed significant improvements in their overall health. An increase in the treatment efficacy rate, sleep quality, and quality of life indicators after the acupuncture treatment was confirmed. The severity of pain as assessed using the visual analog scale (VAS) scores and International RLS Study Group Rating Scale (IRLSRS) scores and the severity of RLS symptoms were significantly reduced. Any significant side effects were not reported. Acupuncture is suggested as an effective and safe treatment method for RLS. However, further large-scale RCT studies are needed to confirm our findings.

A new blind adaptive method using RLS algorithm with Decision direction method

  • Kwon, Tae-song;Yoo, Sung-kyun;Kwak, Kyung-sup
    • Proceedings of the IEEK Conference
    • /
    • 2002.07c
    • /
    • pp.1586-1589
    • /
    • 2002
  • RLS algorithm is a kind of the adaptive algorithms in smart antennas and adapts the weight vector using the difference between the output signal of array antennas and the known training sequence. In this paper, we propose a new algorithm based on the RLS algorithm. It calculates the error signal with reference signal derived from blind scheme. Simulation results show that the proposed algorithm yields more user capacity by 67∼74% than other blind adaptive algorithms(LS-DRMTA, LS-DRMTCMA) at the same BER and the beamformer forms null beams toward interference signals and the main beam toward desired signal.

  • PDF

Time Variant Parameter Estimation using RLS Algorithm with Adaptive Forgetting Factor Based on Newton-Raphson Method (Newton-Raphson법 기반의 적응 망각율을 갖는 RLS 알고리즘에 의한 원격센서시스템의 시변파라메타 추정)

  • Kim, Kyung-Yup;Ji, Seok-Joon;Kwak, Lee-Hui;Lee, John-T.
    • Proceedings of the KIEE Conference
    • /
    • 2007.07a
    • /
    • pp.1680-1681
    • /
    • 2007
  • This paper deals with RLS algorithm using Newton-Raphson method based adaptive forgetting factor for a passive telemetry RF sensor system in order to estimate the time variant parameter to be included in RF sensor model.

  • PDF

A New Polynomial Digital Predistortion Method Based on Direct Learning for Linearizing Nonlinear Power Amplifier (비선형 앰프의 선형화를 위한 다항식 기반 직접 학습 방식의 디지털 사전왜곡 기법)

  • Jeong, Eui-Rim
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.11 no.12
    • /
    • pp.2382-2390
    • /
    • 2007
  • A new polynomial-based predistortion method for linearizing nonlinear power amplifier is proposed. The proposed method finds the predistortion parameter directly without the help of postdistorter whereas most existing polynomial-based predistortion methods calculate the predistortion parameter indirectly from the prostdistorter. First, a new predistortion algorithm is derived based on the assumption that the characteristic of the amplifier is modeled by piecewise linear function. Then it is modified into a proposed method which does not require any assumption or prior knowledge of the amplifier. The proposed method is derived based on the RLS (recursive least squares) algorithm. The proposed technique is simpler to implement than the existing methods and the computer simulation demonstrates that the proposed method is more robust to the initial condition and the saturation region of the amplifier.

Research Trend of Traditional Chinese Medicine in the Treatment of Restless Legs Syndrome (하지불안증후군의 중의치료 연구 동향)

  • Kim, Tae-Heon;Jung, Jin-Hyung;Choi, Yun-Hee;Kim, Bo-Kyung
    • Journal of Oriental Neuropsychiatry
    • /
    • v.25 no.2
    • /
    • pp.165-178
    • /
    • 2014
  • Objectives: This study was conducted to assess how Traditional Chinese Medicine treats the medical condition of Restless Legs Syndrome (RLS). Methods: The authors searched for relevant articles through the CNKI (China National Knowledge Infrastructure-www.global.cnki.net) with the following keywords: The main search was for the term 'RLS,' with supportive words added such as 'Acupunture', 'Acupoint', 'Meridian', 'Moxibustion', 'Massage', 'Acupoint injection'. Our search yielded a total of 233 articles; there were a total of 71 articles related to clinical fields. We then analyzed the chosen articles using a number of criteria including the study type used, the treatment method utilized, and the main effect of the treatment. Results: The 71 analyzed articles utilized the following type of study design: 4 were classified as Quasi-randomised trial, 22 as Randomized Controlled Trial, and 45 as a case report. Regarding the treatment used for RLS, 25 studies examined a single treatment modality, while 46 studies examined a complex treatment modality. There were a total of 10 types of acupuncture treatment used in treating RLS; several massage and acupoint injection method were also found. Finally, there were a few studies that used Moxibustion, as well as several supportive treatments like Cupping, Moxibustion, Steam-Washing, TDP (Teding Dancibo Pu) were found. Conclusions: Traditional Chinese Medicine has used a variety of different study designs and treatments vis-a-vis RLS. These treatments are also used to treat the condition in South Korea.

New Motor Parameter Estimation Method of Surface-mounted Permanent Magnet Motors (표면 부착형 영구자석 전동기의 새로운 상수 추정 방법)

  • Lee, Dong-Myung
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.20 no.4
    • /
    • pp.517-522
    • /
    • 2019
  • This paper proposes a new motor parameter estimation method. Because the proposed method is based on difference equations, it does not affect the error in the voltage magnitude so called dead-time effect. Information on the motor constant may be needed to improve the motor control performance. For example, a control technique called DTC (Direct Torque Control) requires a motor constant when calculating the torque and flux magnitude. As another example, in the case of predictive control, information on the motor parameters is required to generate voltage references. Because the constant of the motor fluctuates according to the driving environment, it is essential to estimate the correct motor constant because the control performance is degraded when incorrect motor information is used. In the proposed scheme, the motor constant estimated based on the voltage difference equation is obtained using the RLS (Recursive Least Square) technique. The RLS algorithm is applied to obtain the value through an iterative calculation so that the estimation performance is robust to noise. The simulation results carried out with surface mounted permanent magnet motors confirmed the validity of the proposed method.

Development of Multiple RLS and Actuator Performance Index-based Adaptive Actuator Fault-Tolerant Control and Detection Algorithms for Longitudinal Autonomous Driving (다중 순환 최소 자승 및 성능 지수 기반 종방향 자율주행을 위한 적응형 구동기 고장 허용 제어 및 탐지 알고리즘 개발)

  • Oh, Sechan;Lee, Jongmin;Oh, Kwangseok;Yi, Kyongsu
    • Journal of Auto-vehicle Safety Association
    • /
    • v.14 no.2
    • /
    • pp.26-38
    • /
    • 2022
  • This paper proposes multiple RLS and actuator performance index-based adaptive actuator fault-tolerant control and detection algorithms for longitudinal autonomous driving. The proposed algorithm computes the desired acceleration using feedback law for longitudinal autonomous driving. When actuator fault or performance degradation exists, it is designed that the desired acceleration is adjusted with the calculated feedback gains based on multiple RLS and gradient descent method for fault-tolerant control. In order to define the performance index, the error between the desired and actual accelerations is used. The window-based weighted error standard deviation is computed with the design parameters. Fault level decision algorithm that can represent three fault levels such as normal, warning, emergency levels is proposed in this study. Performance evaluation under various driving scenarios with actuator fault was conducted based on co-simulation of Matlab/Simulink and commercial software (CarMaker).

Unknown-Parameter Identification for Accurate Control of 2-Link Manipulator using Dual Extended Kalman Filter (2링크 매니퓰레이터 제어를 위한 듀얼 확장 칼만 필터 기반의 미지 변수 추정 기법)

  • Seung, Ji Hoon;Park, Jung Kil;Yoo, Sung Goo
    • Journal of the Korea Convergence Society
    • /
    • v.9 no.6
    • /
    • pp.53-60
    • /
    • 2018
  • In this paper, we described the unknown parameter identification using Dual Extended Kalman Filter for precise control of 2-link manipulator. 2-link manipulator has highly non-linear characteristic with changed parameter thought tasks. The parameter kinds of mass and inertia of system is important to handle with the manipulator robustly. To solve the control problem by estimating the state and unknown parameters of the system through the proposed method. In order to verify the performance of proposed method, we simulate the implementation using Matlab and compare with results of RLS algorithm. At the results, proposed method has a better performance than those of RLS and verify the estimation performance in the parameter estimation.