• 제목/요약/키워드: stochastic control systems

검색결과 239건 처리시간 0.031초

Mobile Robot Localization and Mapping using a Gaussian Sum Filter

  • Kwok, Ngai Ming;Ha, Quang Phuc;Huang, Shoudong;Dissanayake, Gamini;Fang, Gu
    • International Journal of Control, Automation, and Systems
    • /
    • 제5권3호
    • /
    • pp.251-268
    • /
    • 2007
  • A Gaussian sum filter (GSF) is proposed in this paper on simultaneous localization and mapping (SLAM) for mobile robot navigation. In particular, the SLAM problem is tackled here for cases when only bearing measurements are available. Within the stochastic mapping framework using an extended Kalman filter (EKF), a Gaussian probability density function (pdf) is assumed to describe the range-and-bearing sensor noise. In the case of a bearing-only sensor, a sum of weighted Gaussians is used to represent the non-Gaussian robot-landmark range uncertainty, resulting in a bank of EKFs for estimation of the robot and landmark locations. In our approach, the Gaussian parameters are designed on the basis of minimizing the representation error. The computational complexity of the GSF is reduced by applying the sequential probability ratio test (SPRT) to remove under-performing EKFs. Extensive experimental results are included to demonstrate the effectiveness and efficiency of the proposed techniques.

제어 장벽함수를 이용한 안전한 행동 영역 탐색과 제어 매개변수의 실시간 적응 (Online Adaptation of Control Parameters with Safe Exploration by Control Barrier Function)

  • 김수영;손흥선
    • 로봇학회논문지
    • /
    • 제17권1호
    • /
    • pp.76-85
    • /
    • 2022
  • One of the most fundamental challenges when designing controllers for dynamic systems is the adjustment of controller parameters. Usually the system model is used to get the initial controller, but eventually the controller parameters must be manually adjusted in the real system to achieve the best performance. To avoid this manual tuning step, data-driven methods such as machine learning were used. Recently, reinforcement learning became one alternative of this problem to be considered as an agent learns policies in large state space with trial-and-error Markov Decision Process (MDP) which is widely used in the field of robotics. However, on initial training step, as an agent tries to explore to the new state space with random action and acts directly on the controller parameters in real systems, MDP can lead the system safety-critical system failures. Therefore, the issue of 'safe exploration' became important. In this paper we meet 'safe exploration' condition with Control Barrier Function (CBF) which converts direct constraints on the state space to the implicit constraint of the control inputs. Given an initial low-performance controller, it automatically optimizes the parameters of the control law while ensuring safety by the CBF so that the agent can learn how to predict and control unknown and often stochastic environments. Simulation results on a quadrotor UAV indicate that the proposed method can safely optimize controller parameters quickly and automatically.

지반-구조물 상호작용을 고려한 복합제어시스템의 최적설계 (Optimal Design of Integrated Control System Considering Soil-Structure Interaction)

  • 박관순;박장호
    • 한국안전학회지
    • /
    • 제27권2호
    • /
    • pp.57-64
    • /
    • 2012
  • For the vibration control of earthquake-excited buildings, an optimal design method of integrated control system considering soil-structure interaction is studied in this paper. Interaction between soils and the base of the building is simply modeled as lumped parameters and equations of motion are derived. The equations of motion are transformed into the state space equations and the probabilistic excitations such as Kanai-Tajumi power spectral density function is introduced. Then an optimization problem is formulated as finding hybrid or integrated control systems which minimizes the stochastic responses of the building structure for given constraints. In order to investigate the feasibility of the optimization method, an example design and numerical simulations are performed with tenstory building. Finally, numerical results are compared with a conventional design case that soil-structure interaction is not considered.

Improvement of Evolutionary Computation of Genetic Algorithm using SVM

  • Cho, Byung-Sun;Han, So-Hee;Son, Sung-Han;Kim, Jin-Su;Park, Kang-Bak
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2003년도 ICCAS
    • /
    • pp.1513-1516
    • /
    • 2003
  • Genetic algorithm is well known as a stochastic searching method. In this paper, a modified genetic algorithm using 'Suppor Vector Machines (SVM)' is proposed. SVM is used to reduce the number of calling the objective function which in turn accelerate the searching speed compared to the conventional GA.

  • PDF

가변구조제어계의 시변 슬라이딩 레짐에 관한 연구 (A Study on Time-Varying Sliding Regime of VSC System)

  • 김중완;이만형
    • 한국정밀공학회지
    • /
    • 제6권2호
    • /
    • pp.30-39
    • /
    • 1989
  • Variable structure control (VSC) systems control the state vectors using sliding regime (SR) constructed switching logic, switching plane and control law. Saturation function switching logic is used to improve the drawback which occurs in traditional sign function switching logic. Switching plane with time-varying parameter is proposed to improve the drawback which occurs in switching plane with constant parameter and it is suggested the control law which has time-varying parameter. The stability of VSC system controlled by proposed time-varying SR is discussed, and the good control behavior was shown through computer simulation using proposed SR.

  • PDF

Recursive Unscented Kalman Filtering based SLAM using a Large Number of Noisy Observations

  • Lee, Seong-Soo;Lee, Suk-Han;Kim, Dong-Sung
    • International Journal of Control, Automation, and Systems
    • /
    • 제4권6호
    • /
    • pp.736-747
    • /
    • 2006
  • Simultaneous Localization and Map Building(SLAM) is one of the fundamental problems in robot navigation. The Extended Kalman Filter(EKF), which is widely adopted in SLAM approaches, requires extensive computation. The conventional particle filter also needs intense computation to cover a high dimensional state space with particles. This paper proposes an efficient SLAM method based on the recursive unscented Kalman filtering in an environment including a large number of landmarks. The posterior probability distributions of the robot pose and the landmark locations are represented by their marginal Gaussian probability distributions. In particular, the posterior probability distribution of the robot pose is calculated recursively. Each landmark location is updated with the recursively updated robot pose. The proposed method reduces filtering dimensions and computational complexity significantly, and has produced very encouraging results for navigation experiments with noisy multiple simultaneous observations.

일반적인 GPS 수신기를 위한 채널별 다중경로오차 검출 기법 (Channelwise Multipath Detection for General GPS Receivers)

  • 이형근;이장규;지규인
    • 제어로봇시스템학회논문지
    • /
    • 제8권9호
    • /
    • pp.818-826
    • /
    • 2002
  • Since multipath phenomenon frequently occurs when a Global Positioning System receiver is placed in urban area crowded with large buildings, efficient mitigation of multipath effects is necessary to resolve. In this paper, we propose a new multipath detection technique that is useful in real-time positioning with a general Global Positioning System receiver. The proposed technique is based on a channelwise multipath test statistic that efficiently indicates the degree of fluctuations induced by multipath error. The proposed multipath test statistic is operationally advantageous because it does not require any specialized hardware nor any pre-computation of receiver position, it is directly related to standard $\chi$$^2$-distributions, and it can adjust the detection resolution by increasing the number of successive measurements. Simulation and experiment results verify the performance of the proposed multipath detection technique.

HMM-Based Transient Identification in Dynamic Process

  • Kwon, Kee-Choon
    • Transactions on Control, Automation and Systems Engineering
    • /
    • 제2권1호
    • /
    • pp.40-46
    • /
    • 2000
  • In this paper, a transient identification based on a Hidden Markov Model (HMM) has been suggested and evaluated experimentally for the classification of transients in the dynamic process. The transient can be identified by its unique time dependent patterns related to the principal variables. The HMM, a double stochastic process, can be applied to transient identification which is a spatial and temporal classification problem under a statistical pattern recognition framework. The HMM is created for each transient from a set of training data by the maximum-likelihood estimation method. The transient identification is determined by calculating which model has the highest probability for the given test data. Several experimental tests have been performed with normalization methods, clustering algorithms, and a number of states in HMM. Several experimental tests have been performed including superimposing random noise, adding systematic error, and untrained transients. The proposed real-time transient identification system has many advantages, however, there are still a lot of problems that should be solved to apply to a real dynamic process. Further efforts are being made to improve the system performance and robustness to demonstrate reliability and accuracy to the required level.

  • PDF

시간논리구조에서 이산사건시스템의 최적화 (Optimization of discrete event system in a temporal logic framework)

  • 황형수;오성권;정용만
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1996년도 한국자동제어학술회의논문집(국내학술편); 포항공과대학교, 포항; 24-26 Oct. 1996
    • /
    • pp.812-815
    • /
    • 1996
  • In this paper, we consider the optimal control problem based on Discrete Event Dynamic Systems(DEDS) in the Temporal Logic framework(TLF) which have studied for a convenient modeling technique. The TLF is enhanced with objective functions(event cost indices) and a measurement space is also defined. Our research goal is the design of the optimal controller for DEDSs. This procedure could be guided by the heuristic search methods. For the heuristic search, we suggested the Stochastic Ruler algorithm, instead of the A algorithm with difficulties as following; the uniqueness of solutions, the computational complexity and how to select a heuristic function. This SR algorithm is used for solving the optimal problem. An example is shown to illustrate our results.

  • PDF

스트랩다운 적외선 영상센서를 위한 관성센서 기반 강인최소자승 움직임 훼손영상 복원 기법 (Robust Least Squares Motion Deblurring Using Inertial Sensor for Strapdown Image IR Sensors)

  • 김기승;나성웅
    • 제어로봇시스템학회논문지
    • /
    • 제18권4호
    • /
    • pp.314-320
    • /
    • 2012
  • This paper proposes a new robust motion deblurring filter using the inertial sensor measurements for strapdown image IR applications. With taking the PSF measurement error into account, the motion blurred image is modeled by the linear uncertain state space equation with the noise corrupted measurement matrix and the stochastic parameter uncertainty. This motivates us to solve the motion deblurring problem based on the recently developed robust least squares estimation theory. In order to suppress the ringing effect on the deblurred image, the robust least squares estimator is slightly modified by adoping the ridge-regression concept. Through the computer simulations using the actual IR scenes, it is demonstrated that the proposed algorithm shows superior and reliable motion deblurring performance even in the presence of time-varying motion artifact.