• Title/Summary/Keyword: RLS method

Search Result 140, Processing Time 0.026 seconds

Robot Control via RPO-based Reinforcement Learning Algorithm (RPO 기반 강화학습 알고리즘을 이용한 로봇제어)

  • Kim, Jong-Ho;Kang, Dae-Sung;Park, Joo-Young
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.15 no.4
    • /
    • pp.505-510
    • /
    • 2005
  • The RPO(randomized policy optimizer) algorithm, which utilizes probabilistic policy for the action selection, is a recently developed tool in the area of reinforcement learning, and has been shown to be very successful in several application problems. In this paper, we propose a modified RPO algorithm, whose critic network is adapted via RLS(Recursive Least Square) algorithm. In order to illustrate the applicability of the modified RPO method, we applied the modified algorithm to Kimura's robot and observed very good performance. We also developed a MATLAB-based animation program, by which the effectiveness of the training algorithms on the acceleration or the robot movement were observed.

Real-Time Seam Tracking System Using a Visual Device with Vertical Projection of Laser Beam (레이저빔 수직투사 구조의 시각장치를 이용한 실시간 용접선추적 시스템)

  • Kim, Jin-Dae;Lee, Jeh-Won;Shin, Chan-Bai
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.24 no.10
    • /
    • pp.64-74
    • /
    • 2007
  • Because of the size and environment in the shipbuilding process, the portable type robot is required for the automatic seam tracking. For this reason, the structure of laser sensor should be considered in the initial design step and the coordinate transformation between welding robot and laser sensor, which is joint finder, must be identified exactly and the real time tracking algorithm based on these consideration could be developed. In this research, laser displacement sensor in which its structure is laser beam's vertical projection, is developed to recognize the location of weld joint. In practical applications, however, images of weld joints are often degraded because of the surface specularity or spatter. To overcome the problem, the constrained joint finding algorithm is proposed. In the approach of coordinate conversion rule for the visual feedback control among welding torch, robot body and laser sensor is applied by the same reference point method. In the real time seam tracking algorithms we propose constrained sampling method which uses look ahead distance. The RLS(Recursive Least Square) filter is applied to obtain the smooth tracking path from the sensitive edge data. From the experimental results, we could see the possibility that the developed laser sensor with proposed processing algorithm and real time seam tracking method can be used as a welding under the shipbuilding condition.

A Study on Korean Phoneme Classification using Recursive Least-Square Algorithm (Recursive Least-Square 알고리즘을 이용한 한국어 음소분류에 관한 연구)

  • Kim, Hoe-Rin;Lee, Hwang-Su;Un, Jong-Gwan
    • The Journal of the Acoustical Society of Korea
    • /
    • v.6 no.3
    • /
    • pp.60-67
    • /
    • 1987
  • In this paper, a phoneme classification method for Korean speech recognition has been proposed and its performance has been studied. The phoneme classification has been done based on the phonemic features extracted by the prewindowed recursive least-square (PRLS) algorithm that is a kind of adaptive filter algorithms. Applying the PRLS algorithm to input speech signal, precise detection of phoneme boundaries has been made, Reference patterns of Korean phonemes have been generated by the ordinery vector quantization (VQ) of feature vectors obtained manualy from prototype regions of each phoneme. In order to obtain the performance of the proposed phoneme classification method, the method has been tested using spoken names of seven Korean cities which have eleven different consonants and eight different vowels. In the speaker-dependent phoneme classification, the accuracy is about $85\%$ considering simple phonemic rules of Korean language, while the accuracy of the speaker-independent case is far less than that of the speaker-dependent case.

  • PDF

Determination of Design Width for Medium Streams in the Han River Basin (한강유역의 중소하천에 대한 계획하폭 산정)

  • Jeon, Se-Jin;An, Tae-Jin;Park, Jeong-Eung
    • Journal of Korea Water Resources Association
    • /
    • v.31 no.6
    • /
    • pp.675-684
    • /
    • 1998
  • This paper presents the empirical formulas for determining the design-width for medium rivers in the Han river basin. The design flood, the watershed ares, and the channel slope of 216 medium rivers in the Han river basin are collected. the design width formulas are then determined by 1) the least squares (LS) method, 2)the least median squares (LMS) method, and 3) the reweighted least squares method based on the LMS (RLS). The six types of formulas are considered to determine the acceptable type for medium streams in the Han river basin. The root mean squared errors (RMSE), the absolute mean (AME) errors, and the mean errors (ME) are computed to test the formulas derived by three regression methods. It si found that the equation related stream width to the watershed area and the channel slope is acceptable for determining the design width for medium streams in the Han river basin. It is expected that the equations proposed by this study be used an index for determining the design-width for medium streams in the Han river basin.

  • PDF

Sliding Mode Observer (SMO) using Aging Compensation based State-of-Charge(SOC) Estimation for Li-Ion Battery Pack

  • Kim, Jonghoon;Nikitenkov, Dmitry;Denisova, Valeria
    • Proceedings of the KIPE Conference
    • /
    • 2013.11a
    • /
    • pp.200-201
    • /
    • 2013
  • This paper investigates a new approach for Li-Ion battery state-of-charge (SOC) estimation using sliding mode observer (SMO) technique including parameters aging compensation via recursive least squares (RLS). The main advantages of this approach would be low computational load, easiness of implementation along with the robustness of the method for internal battery model parameters estimation. The proposed algorithm was first tested on a set of acquired battery data using implementation in Simulink and later developed as C-code module for firmware application.

  • PDF

Adaptive model predictive control using ARMA models (ARMA 모델을 이용한 적응 모델예측제어에 관한 연구)

  • 이종구;김석준;박선원
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1993.10a
    • /
    • pp.754-759
    • /
    • 1993
  • An adaptive model predictive control (AMPC) strategy using auto-regression moving-average (ARMA) models is presented. The characteristic features of this methodology are the small computer memory requirement, high computational speed, robustness, and easy handling of nonlinear and time varying MIMO systems. Since the process dynamic behaviors are expressed by ARMA models, the model parameter adaptation is simple and fast to converge. The recursive least square (RLS) method with exponential forgetting is used to trace the process model parameters assuming the process is slowly time varying. The control performance of the AMPC is verified by both comparative simulation and experimental studies on distillation column control.

  • PDF

A study on Transfer Function Identification of Motor-Mechanical System with PMSM (PMSM으로 구성된 모터-기구부 시스템의 전달함수 추정에 관한 연구)

  • Park, Seung-Kyu;Choi, Young-Kwon;Park, Doo-Hwan;Ahn, Ho-Kyun
    • Proceedings of the KIEE Conference
    • /
    • 2002.11c
    • /
    • pp.546-549
    • /
    • 2002
  • In this paper, a simulation system, which is almost same with the real motor-mechanical control system, is established. The real system is identified by using the data from DSP(TMS320F240). The RLS(Recursive Least Square) algorithm is used for the identification and MATLAB Simulink program is used for simulation. The exact simulation system obtained by using the proposed method is very useful for analysis and design of motor-mechanical control systems.

  • PDF

Implementation of Equalizer Algorithm using FTF Method for HomePNA2.0 Systems (HomePNA 2.0 시스템에서 FTF 방법을 이용한 등화기 알고리즘 구현)

  • 전병관;박기태;신요안;이원철
    • Proceedings of the IEEK Conference
    • /
    • 2002.06a
    • /
    • pp.65-68
    • /
    • 2002
  • 본 논문은 HomePNA 2.0 시스템에서 채널에 의한 왜곡을 보상하기 위한 방안을 제시하는 것으로서 심벌률과 전송 방식에 따른 등화기를 Fast RLS 알고리즘인 FTF (Fast Transversal Filter) 알고리즘을 사용하여 구현하여 그 성능을 분석하며, 또한 헤더 부분의 미결정 심벌들을 이용하는 DFE (Decision Feedback Equalizer)형태로 등화기를 구성하고 이에 대한 성능을 분석하고자한다.

  • PDF

Parallel Type Neural Network for Direct Control Method of Nonlinear System (비선형 시스템의 직접제어방식을 위한 병렬형 신경회로망)

  • 김주웅;정성부;서원호;엄기환
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2000.05a
    • /
    • pp.406-409
    • /
    • 2000
  • We propose the modified neural network which are paralleled to control nonlinear systems. The proposed method is a direct control method to use inverse model of the plant. Nonlinear systems are divided into two parts; linear part and nonlinear part, and it is controlled by RLS method and recursive multi-layer neural network with each other. We simulate to verify the performance of the proposed method and are compared with conventional direct neural network control method. The proposed control method is improved the control performance than the conventional method.

  • PDF

Predistorter Design for a Memory-less Nonlinear High Power Amplifier Using the $rho$th-Order Inverse Method for OFDM Systems ($rho$차 역필터 기법을 이용한 OFDM 시스템의 메모리가 없는 비선형 고전력 증폭기의 전치 보상기 설계)

  • Lim, Sun-Min;Eun, Chang-Soo
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.31 no.2C
    • /
    • pp.191-199
    • /
    • 2006
  • In this paper, we propose a method to implement a predistorter of the $rho$-th order inverse filter structure to prevent signal distortion and spectral re-growth due to the high PAPR (peak-to-average ratio) of the OFDM signals and the non-linearity of high-power amplifiers. We model the memory-less non-linearity of the high-power amplifier with a polynomial model and utilize the inverse of the model, the $rho$-th order inverse filter, for the predistorter. Once the non-linearity is modeled with a polynomial, since we can determine the $rho$-th order inverse filter only with the coefficients of the polynomial, large memory is not required. To update the coefficients of the non-linear high-power amplifier model, we can use LMS or RLS algorithms. The convergence speed is high since the number of coefficients is small, and the computation is simple since manipulation of complex numbers is not necessary.