• Title/Summary/Keyword: Stochastic Systems

Search Result 767, Processing Time 0.022 seconds

Hyperbolic Quotient 경쟁학습 신경회로망을 사용한 비선형 확률시스템 제어에 관한 연구 (A Study on a Stochastic Nonlinear System Control Using Hyperbolic Quotient Competitive Learning Neural Networks)

  • 석진욱;조성원;최경삼
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 1998년도 추계학술대회 학술발표 논문집
    • /
    • pp.346-352
    • /
    • 1998
  • In this paper, we give some geometric condition for a stochastic nonlinear system and we propose a control method for a stochastic nonlinear system using neural networks. Since a competitive learning neural networks has been developed based on the stochastic approximation method, it is regarded as a stochastic recursive filter algorithm. In addition, we provide a filtering and control condition for a stochastic nonlinear system, called perfect filtering condition, in a viewpoint of stochastic geometry. The stochastic nonlinear system satisfying the perfect filtering condition is decoupled with a deterministic part and purely semi martingale part. Hence, the above system can be controlled by conventional control laws and various intelligent control laws. Computer simulation shows that the stochastic nonlinear system satisfying the perfect filtering condition is controllable. and the proposed neural controller is more efficient than the conventional LQG controller and the canoni al LQ-Neural controller.

  • PDF

확률적 견실특성을 고려한 고유구조 지정기법 (Eigenstructure Assignment Methodology Considering Stochastic Robustness Characteristics)

  • 서영봉;최재원
    • 제어로봇시스템학회논문지
    • /
    • 제6권11호
    • /
    • pp.974-980
    • /
    • 2000
  • In this paper, we present a method that has flexibility of exact assignment of eigenstructure with the stochastic robustness for LTI(Linear-Time-Invariant) systems. The stochastic robustness of LTI systems is determined by the probability distributions of closed-loop eigenvalues. The probabilistic stability region is presented stochastically using the Monte Carlo evaluations. The proposed scheme is applied to designing a simple system and a flight control system with stochastic parameter variations to confirm the usefulness of the scheme.

  • PDF

혼합 군에 대한 확률적 란체스터 모형의 정규근사 (Gaussian Approximation of Stochastic Lanchester Model for Heterogeneous Forces)

  • 박동현;김동현;문형일;신하용
    • 대한산업공학회지
    • /
    • 제42권2호
    • /
    • pp.86-95
    • /
    • 2016
  • We propose a new approach to the stochastic version of Lanchester model. Commonly used approach to stochastic Lanchester model is through the Markov-chain method. The Markov-chain approach, however, is not appropriate to high dimensional heterogeneous force case because of large computational cost. In this paper, we propose an approximation method of stochastic Lanchester model. By matching the first and the second moments, the distribution of each unit strength can be approximated with multivariate normal distribution. We evaluate an approximation of discrete Markov-chain model by measuring Kullback-Leibler divergence. We confirmed high accuracy of approximation method, and also the accuracy and low computational cost are maintained under high dimensional heterogeneous force case.

Semi-active bounded optimal control of uncertain nonlinear coupling vehicle system with rotatable inclined supports and MR damper under random road excitation

  • Ying, Z.G.;Yan, G.F.;Ni, Y.Q.
    • Coupled systems mechanics
    • /
    • 제7권6호
    • /
    • pp.707-729
    • /
    • 2018
  • The semi-active optimal vibration control of nonlinear torsion-bar suspension vehicle systems under random road excitations is an important research subject, and the boundedness of MR dampers and the uncertainty of vehicle systems are necessary to consider. In this paper, the differential equations of motion of the coupling torsion-bar suspension vehicle system with MR damper under random road excitation are derived and then transformed into strongly nonlinear stochastic coupling vibration equations. The dynamical programming equation is derived based on the stochastic dynamical programming principle firstly for the nonlinear stochastic system. The semi-active bounded parametric optimal control law is determined by the programming equation and MR damper dynamics. Then for the uncertain nonlinear stochastic system, the minimax dynamical programming equation is derived based on the minimax stochastic dynamical programming principle. The worst-case disturbances and corresponding semi-active bounded parametric optimal control are obtained from the programming equation under the bounded disturbance constraints and MR damper dynamics. The control strategy for the nonlinear stochastic vibration of the uncertain torsion-bar suspension vehicle system is developed. The good effectiveness of the proposed control is illustrated with numerical results. The control performances for the vehicle system with different bounds of MR damper under different vehicle speeds and random road excitations are discussed.

Kalman Filtering for Linear Time-Delayed Continuous-Time Systems with Stochastic Multiplicative Noises

  • Zhang, Huanshui;Lu, Xiao;Zhang, Weihai;Wang, Wei
    • International Journal of Control, Automation, and Systems
    • /
    • 제5권4호
    • /
    • pp.355-363
    • /
    • 2007
  • The paper deals with the Kalman stochastic filtering problem for linear continuous-time systems with both instantaneous and time-delayed measurements. Different from the standard linear system, the system state is corrupted by multiplicative white noise, and the instantaneous measurement and the delayed measurement are also corrupted by multiplicative white noise. A new approach to the problem is presented by using projection formulation and reorganized innovation analysis. More importantly, the proposed approach in the paper can be applied to solve many complicated problems such as stochastic $H_{\infty}$ estimation, $H_{\infty}$ control stochastic system with preview and so on.

EXISTENCE-AND-UNIQUENESS AND MEAN-SQUARE BOUNDEDNESS OF THE SOLUTION TO STOCHASTIC CONTROL SYSTEMS

  • Lu, Peilin;Cao, Caixia
    • Journal of applied mathematics & informatics
    • /
    • 제31권3_4호
    • /
    • pp.513-522
    • /
    • 2013
  • This paper mainly deals with the stochastic control system, the existence and uniqueness of solutions and the behavior of solutions are investigated. Firstly, we obtain sufficient conditions which guarantee the existence and uniqueness of solutions to the stochastic control system. And then, boundedness of the solution to the system is achieved under mean-square linear growth condition.

미지입력이 존재하는 선형 이산 활률 시스템의 최소 분산 고장 진단 필터의 설계 (Design of Minimum Variance Fault Diagnosis Filter for Linear Discrete-Time Stochastic Systems with Unknown Inputs)

  • 이재혁
    • 전자공학회논문지B
    • /
    • 제31B권8호
    • /
    • pp.39-46
    • /
    • 1994
  • In this paper a state reconstruction filter for linear discrete-time stochastic systems with unknown inputs and noises is presented. The suggested filter can estimate the system state vector and the unknown inputs simultaneously As an extension of the filter a fault diagnosis filter for linear discrete-time stochastic systems with unknown inputs and noises is presented for each filters the optimal gain determination methods which minimize the variance of the state reconstruction errorare presented. Finally the usability of the filtersis shown via numerical examples.

  • PDF

시변 지연이 존재하는 불확실 스토캐스틱 시스템의 지연의존 안정성 (New Delay-dependent Stability Criteria for Uncertain Stochastic Systems with Time-varying Delays)

  • 권오민;박주현;이상문
    • 전기학회논문지
    • /
    • 제58권11호
    • /
    • pp.2261-2265
    • /
    • 2009
  • In this paper, the problem of delay-dependent stability of uncertain stochastic systems with time-varying delay is considered. The uncertainties are assumed to be norm-bounded. Based on the Lyapunov stability theory, new delay-dependent stability criteria for the system are derived in terms of LMI(linear matrix inequality). Two numerical examples are given to show the effectiveness of proposed method.

Nonlinear stochastic optimal control strategy of hysteretic structures

  • Li, Jie;Peng, Yong-Bo;Chen, Jian-Bing
    • Structural Engineering and Mechanics
    • /
    • 제38권1호
    • /
    • pp.39-63
    • /
    • 2011
  • Referring to the formulation of physical stochastic optimal control of structures and the scheme of optimal polynomial control, a nonlinear stochastic optimal control strategy is developed for a class of structural systems with hysteretic behaviors in the present paper. This control strategy provides an amenable approach to the classical stochastic optimal control strategies, bypasses the dilemma involved in It$\hat{o}$-type stochastic differential equations and is applicable to the dynamical systems driven by practical non-stationary and non-white random excitations, such as earthquake ground motions, strong winds and sea waves. The newly developed generalized optimal control policy is integrated in the nonlinear stochastic optimal control scheme so as to logically distribute the controllers and design their parameters associated with control gains. For illustrative purposes, the stochastic optimal controls of two base-excited multi-degree-of-freedom structural systems with hysteretic behavior in Clough bilinear model and Bouc-Wen differential model, respectively, are investigated. Numerical results reveal that a linear control with the 1st-order controller suffices even for the hysteretic structural systems when a control criterion in exceedance probability performance function for designing the weighting matrices is employed. This is practically meaningful due to the nonlinear controllers which may be associated with dynamical instabilities being saved. It is also noted that using the generalized optimal control policy, the maximum control effectiveness with the few number of control devices can be achieved, allowing for a desirable structural performance. It is remarked, meanwhile, that the response process and energy-dissipation behavior of the hysteretic structures are controlled to a certain extent.

강화학습법을 이용한 유역통합 저수지군 운영 (Basin-Wide Multi-Reservoir Operation Using Reinforcement Learning)

  • 이진희;심명필
    • 한국수자원학회:학술대회논문집
    • /
    • 한국수자원학회 2006년도 학술발표회 논문집
    • /
    • pp.354-359
    • /
    • 2006
  • The analysis of large-scale water resources systems is often complicated by the presence of multiple reservoirs and diversions, the uncertainty of unregulated inflows and demands, and conflicting objectives. Reinforcement learning is presented herein as a new approach to solving the challenging problem of stochastic optimization of multi-reservoir systems. The Q-Learning method, one of the reinforcement learning algorithms, is used for generating integrated monthly operation rules for the Keum River basin in Korea. The Q-Learning model is evaluated by comparing with implicit stochastic dynamic programming and sampling stochastic dynamic programming approaches. Evaluation of the stochastic basin-wide operational models considered several options relating to the choice of hydrologic state and discount factors as well as various stochastic dynamic programming models. The performance of Q-Learning model outperforms the other models in handling of uncertainty of inflows.

  • PDF