• 제목/요약/키워드: State-Space Model

검색결과 1,024건 처리시간 0.03초

에이전트 기반 시뮬레이션을 통한 디스패칭 시스템의 강화학습 모델 (A Reinforcement Learning Model for Dispatching System through Agent-based Simulation)

  • 김민정;신문수
    • 산업경영시스템학회지
    • /
    • 제47권2호
    • /
    • pp.116-123
    • /
    • 2024
  • In the manufacturing industry, dispatching systems play a crucial role in enhancing production efficiency and optimizing production volume. However, in dynamic production environments, conventional static dispatching methods struggle to adapt to various environmental conditions and constraints, leading to problems such as reduced production volume, delays, and resource wastage. Therefore, there is a need for dynamic dispatching methods that can quickly adapt to changes in the environment. In this study, we aim to develop an agent-based model that considers dynamic situations through interaction between agents. Additionally, we intend to utilize the Q-learning algorithm, which possesses the characteristics of temporal difference (TD) learning, to automatically update and adapt to dynamic situations. This means that Q-learning can effectively consider dynamic environments by sensitively responding to changes in the state space and selecting optimal dispatching rules accordingly. The state space includes information such as inventory and work-in-process levels, order fulfilment status, and machine status, which are used to select the optimal dispatching rules. Furthermore, we aim to minimize total tardiness and the number of setup changes using reinforcement learning. Finally, we will develop a dynamic dispatching system using Q-learning and compare its performance with conventional static dispatching methods.

하이드라진 추력기의 추력실 특성길이 변화가 연소성능에 미치는 영향 (Effects of Characteristic Length Variation for Thrust Chamber on the Hot-fire Performance of Hydrazine Thruster)

  • 김종현;정훈;김정수
    • 한국항공우주학회지
    • /
    • 제42권2호
    • /
    • pp.144-149
    • /
    • 2014
  • 우주발사체 자세제어용 하이드라진 추력기의 추력실 특성길이($L^*$) 변화에 따른 연소성능을 확인하기 위해 개발모델 추력기에 대한 지상연소시험을 수행하였다. 각각의 추력기에 대한 성능특성이 추진제 주입압력 2.41 MPa (350 psia)에서의 정상상태 추력, 비추력, 응답특성 및 특성속도 등과 같은 성능변수로 분석되었다. 시험결과, 표준모델 대비 추력실 특성길이의 증가와 감소에 따라 특성속도 및 비추력성능이 공히 감소하였던 바, 표준모델의 추력실 형상이 요구성능에 대하여 가장 적합하게 설계되었다는 사실이 확인되었다.

An elastoplastic bounding surface model for the cyclic undrained behaviour of saturated soft clays

  • Cheng, Xinglei;Wang, Jianhua
    • Geomechanics and Engineering
    • /
    • 제11권3호
    • /
    • pp.325-343
    • /
    • 2016
  • A total stress-based bounding surface model is developed to predict the undrained behaviour of saturated soft clays under cyclic loads based on the anisotropic hardening modulus field and bounding-surface theories. A new hardening rule is developed based on a new interpolation function of the hardening modulus that has simple mathematic expression and fewer model parameters. The evolution of hardening modulus field is described in the deviatoric stress space. It is assumed that the stress reverse points are the mapping centre points and the mapping centre moves with the variation of loading and unloading paths to describe the cyclic stress-strain hysteresis curve. In addition, by introducing a model parameter that reflects the accumulation rate and level of shear strain to the interpolation function, the cyclic shakedown and failure behaviour of soil elements with different combinations of initial and cyclic stresses can be captured. The methods to determine the model parameters using cyclic triaxial compression tests are also studied. Finally, the cyclic triaxial extension and torsional shear tests are performed. By comparing the predictions with the test results, the model can be used to describe undrained cyclic stress-strain responses of elements with different stress states for the tested clays.

Optimal placement of piezoelectric curve beams in structural shape control

  • Wang, Jian;Zhao, Guozhong;Zhang, Hongwu
    • Smart Structures and Systems
    • /
    • 제5권3호
    • /
    • pp.241-260
    • /
    • 2009
  • Shape control of flexible structures using piezoelectric materials has attracted much attention due to its wide applications in controllable systems such as space and aeronautical engineering. The major work in the field is to find a best control voltage or an optimal placement of the piezoelectric actuators in order to actuate the structure shape as close as possible to the desired one. The current research focus on the investigation of static shape control of intelligent shells using spatially distributed piezoelectric curve beam actuators. The finite element formulation of the piezoelectric model is briefly described. The piezoelectric curve beam element is then integrated into a collocated host shell element by using nodal displacement constraint equations. The linear least square method (LLSM) is employed to get the optimum voltage distributions in the control system so that the desired structure shape can be well matched. Furthermore, to find the optimal placement of the piezoelectric curve beam actuators, a genetic algorithm (GA) is introduced in the computation model as well as the consideration of the different objective functions. Numerical results are given to demonstrate the validity of the theoretical model and numerical algorithm developed.

새로운 추정 알고리즘을 이용한 비최소 위상 시스템의 직접 적응 제어 (Direct Adaptive Control of Nonminimum Phase Systems Using Novel Estimation Algorithm)

  • 이선우;김종환
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 1992년도 하계학술대회 논문집 A
    • /
    • pp.377-380
    • /
    • 1992
  • This paper proposes a novel direct adaptive pole placement control algorithm which can be applied to continuous time nonminimum phase systems. The algorithm is based on Lyapunov's direct method. By introducing an auxiliary signal, a minimal error model is constructed in state space. Using the error model an estimation law is obtained via Lyapunov's second stability theorem. The global stability of the overall system is established.

  • PDF

모델링과 검증에 의한 파이프 라인 시스템의 유출 탐지 (Leakage detection of pipeline system based on modeling and identification)

  • 이주형;이광순;송형근
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1991년도 한국자동제어학술회의논문집(국내학술편); KOEX, Seoul; 22-24 Oct. 1991
    • /
    • pp.905-910
    • /
    • 1991
  • This paper presets a leakage detection method based on modeling the leakage in pipeline systems. For gas pipeline systems, a method based on the state space model is suggested. For liquid pipeline systems, an experiment based on the static model equation was performed. In the experiment, it was possible to detect the leak and to diagnosis the leak situation within the error of .+-.3%.

  • PDF

STABILITY OF TWO-PHASE FLOW MODELS

  • Jin, Hyeon-Seong
    • 대한수학회논문집
    • /
    • 제22권4호
    • /
    • pp.587-596
    • /
    • 2007
  • In this paper, we study two-phase flow models. The chunk mix model of the two-phase flow equations is analyzed by a characteristic analysis. The model discussed herein has real characteristic values for all physically acceptable states and except for a set of measure zero has a complete set of characteristic vectors in state space.

자동변속기의 본드선도 모델링 및 제어 (Bond Graph Modeling and Control for an Automatic Transmission)

  • 강민수;강조웅;김종식
    • 한국정밀공학회:학술대회논문집
    • /
    • 한국정밀공학회 2002년도 추계학술대회 논문집
    • /
    • pp.425-430
    • /
    • 2002
  • An automatic transmission model using the bond graph techniques is developed for analyzing shift characteristics of vehicles. Bond graph models can be systemically manipulated to yield state space equations of standard form. Bond graph techniques are applied for modeling overall automatic transmission systems and shift models. A fuzzy controller is synthesized for the verification of a shifting model in the ${1^st} gear to the {2^nd}$ gear. Simulation results show the fitness of models by the bond graph techniques.

  • PDF

소결공정에서의 완전 소결점 위치 제어에 관한 연구 (A Study on Burnthrough Point Control in Sintering Process)

  • 이상정;김점근;고명삼;권욱현
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 1985년도 하계학술회의논문집
    • /
    • pp.55-60
    • /
    • 1985
  • A state-space model of a burn through point control system of an industrial sintering process is derived. The model is then used in designing a self-tuning controller which consists of the receding horizon control law and a least-squares prediction algorithm. By applying this adaptive controller to POSCO sintering process IV, satisfactory expermental results have been obtained. Some of these practical results are presented in this paper.

  • PDF

GPS 신호의 단일차분을 이용한 편대위성의 상대위치 결정을 위한 필터링 성능 분석 (Filtering Performance Analyizing for Relative Navigation Using Single Difference Carrier-Phase GPS)

  • 박인관;박상영;최규홍;조성기;박종욱
    • Journal of Astronomy and Space Sciences
    • /
    • 제25권3호
    • /
    • pp.283-290
    • /
    • 2008
  • 이 논문에서는 간섭계 구성의 기본이 되는 위성 간 상대위치 추정에 관한 알고리즘을 개발하고 검증하였다. 편대위성 간 상대위치 추정을 실시간으로 수행하기 위해 확장칼만필터 (EKF, Extended Kalman Filter)와 Unscented 칼만필터 (UKF, Unscented Kalman Filter) 를 사용하였다. 칼만 필터를 이용한 상태벡터 (state-vector)의 갱신(update)을 위한 관측 데이터는 시뮬레이션을 통해 얻어진 GPS 위성 신호의 단일차분 (Single Difference)에 대한 값을 사용하였다. 이 연구에서 개발한 알고리즘으로 추정된 편대위성 간 상대위치는 확장칼만필터와 Unscented 칼만필터 모두 참 값으로 가정한 STK(Satellite Tool Kit) 의 시뮬레이션된 관측 값에 대해 ${\pm}1m$ 이내의 오차로 수렴함을 확인하였다. 또한 두 종류의 칼만필터를 이용하여 상대위치 결정을 수행함으로써 비선 형성을 가지는 경우 Unscented 칼만필터의 성능이 상대적으로 우수함을 확인할 수 있었다.