• 제목/요약/키워드: epsilon algorithm

검색결과 66건 처리시간 0.024초

Partially Observable Markov Decision Process with Lagged Information over Infinite Horizon

  • Jeong, Byong-Ho;Kim, Soung-Hie
    • 한국경영과학회지
    • /
    • 제16권1호
    • /
    • pp.135-146
    • /
    • 1991
  • This paper shows the infinite horizon model of Partially Observable Markov Decision Process with lagged information. The lagged information is uncertain delayed observation of the process under control. Even though the optimal policy of the model exists, finding the optimal policy is very time consuming. Thus, the aim of this study is to find an .eplison.-optimal stationary policy minimizing the expected discounted total cost of the model. .EPSILON.- optimal policy is found by using a modified version of the well known policy iteration algorithm. The modification focuses to the value determination routine of the algorithm. Some properties of the approximation functions for the expected discounted cost of a stationary policy are presented. The expected discounted cost of a stationary policy is approximated based on these properties. A numerical example is also shown.

  • PDF

화물열차용 제륜자의 열유동 해석 (Numerical Analysis on Heat Transfer and Fluid flow of Brake Shoe for Freight Car)

  • 남성원
    • 한국철도학회:학술대회논문집
    • /
    • 한국철도학회 2001년도 춘계학술대회 논문집
    • /
    • pp.123-128
    • /
    • 2001
  • Numerical simulation is conducted to clarify the heat transfer and fluid flow characteristics of brake shoe for freight car. High order up-wind scheme for governing equations, k-epsilon turbulent model and SIMPLEC algorithm based on finite volume method are used to solve the physical shoe model. The governing equations are solved by TDMA(Tri-Diagonal Matrix Algorithm) with line-by-line method and block correction. From the results of simulation, the characteristics of cooling pattern is strongly affected by the velocity of train and the material of shoe. The face lift of shoe affects on the temperature distribution of rear surface of shoe as well as the front surface of that. Due to the grooves in shoe, it will be expected to cool the frictional heat and result in the reduction of maintenance efforts.

  • PDF

A calculation method for finite depth free-surface green function

  • Liu, Yingyi;Iwashita, Hidetsugu;Hu, Changhong
    • International Journal of Naval Architecture and Ocean Engineering
    • /
    • 제7권2호
    • /
    • pp.375-389
    • /
    • 2015
  • An improved boundary element method is presented for numerical analysis of hydrodynamic behavior of marine structures. A new algorithm for numerical solution of the finite depth free-surface Green function in three dimensions is developed based on multiple series representations. The whole range of the key parameter R/h is divided into four regions, within which different representation is used to achieve fast convergence. The well-known epsilon algorithm is also adopted to accelerate the convergence. The critical convergence criteria for each representation are investigated and provided. The proposed method is validated by several well-documented benchmark problems.

철도차량용 제동 디스크-라이닝의 열유동 해석 (Numerical Heat Transfer and Fluid Flow of Brake Disk-lining for Rolling Stock)

  • 남성원;조장형
    • 한국철도학회:학술대회논문집
    • /
    • 한국철도학회 1999년도 추계학술대회 논문집
    • /
    • pp.93-98
    • /
    • 1999
  • Numerical simulation is conducted to clarify the heat transfer and fluid flow characteristics of brake disk-lining for rolling stock. Multiple rotational reference frame, k-epsilon turbulent model and SIMPLE algorithm based on finite volume method are used to solve the physical disk-lining model. The governing equations are solved by TDMA(TriDiagonal Matrix Algorithm) with line-by-line method and block correction, From the results of simulation, the characteristics of cooling pattern is strongly affected by the grooves in lining. The face lift of lining affects on the temperature distribution of rear surface of lining as well as the front surface of that. Due to the grooves in lining, it will be expected to extend the maintenance life circle of lining.

  • PDF

Research on prediction and analysis of supercritical water heat transfer coefficient based on support vector machine

  • Ma Dongliang;Li Yi;Zhou Tao;Huang Yanping
    • Nuclear Engineering and Technology
    • /
    • 제55권11호
    • /
    • pp.4102-4111
    • /
    • 2023
  • In order to better perform thermal hydraulic calculation and analysis of supercritical water reactor, based on the experimental data of supercritical water, the model training and predictive analysis of the heat transfer coefficient of supercritical water were carried out by using the support vector machine (SVM) algorithm. The changes in the prediction accuracy of the supercritical water heat transfer coefficient are analyzed by the changes of the regularization penalty parameter C, the slack variable epsilon and the Gaussian kernel function parameter gamma. The predicted value of the SVM model obtained after parameter optimization and the actual experimental test data are analyzed for data verification. The research results show that: the normalization of the data has a great influence on the prediction results. The slack variable has a relatively small influence on the accuracy change range of the predicted heat transfer coefficient. The change of gamma has the greatest impact on the accuracy of the heat transfer coefficient. Compared with the calculation results of traditional empirical formula methods, the trained algorithm model using SVM has smaller average error and standard deviations. Using the SVM trained algorithm model, the heat transfer coefficient of supercritical water can be effectively predicted and analyzed.

천장에 열 유속을 갖는 대형 공간에서 화재 발생시 연기거동에 대한 수치해석적 연구 (A Numerical Study of Smoke Movement in Atrium Fires with Ceiling Hea Flux)

  • 정진용;유홍선;김성찬;김충익
    • 한국화재소방학회논문지
    • /
    • 제13권4호
    • /
    • pp.20-29
    • /
    • 1999
  • 본 연구는 두 가지 유형의 아트리움 공간에 대해서 Zone모델과 Field모델을 비교하였으며 특히 천장에 열 유속을 갖는 아트리움 화재에 대해서 SMEP화재 모델을 적용하여 연기거동을 수치해석 하였다. Zone 모델로는 NIST에서 개발된 CFAST 그리고 CSIRO에서 개발된 NBTC 1-room 모델을 사용하여 SMEP Field모델을 검증하였다. PISO 알고리즘과 부력항을 포함한 수정 k-e epsilon 난류모델을 사용한 SMEP은 연속, 운동, 에너지 그리고 농도 방정식을 풀었으며, 상용 Zone 모델들과의 비교는 서로 유사한 결과를 보였다. 천장이 유리로 만들어진 아트리움의 경우, 태양열에 의한 천장 열 유속을 고려함으로써 좀더 실제적인 화재현상을 규명할 수 있다. 수치해석결과 천장 열 유속 조건은 연층의 온도 분포에는 영향을 미치지만 연기의 하강과 거동에는 커다란 영향을 미치지 않고 있음을 확인 할 수 있었다. 따라서 화재 감지기나 배연 설비 시스템의 설치시 이러한 점들이 고려되어야만 한다.

  • PDF

평면벽면분류의 유입경계조건을 가지는 개수로 유동에 관한 수치적 연구 (A Numerical Study on the Open Channel Flow with Plane Wall Jet Inlet Boundary Condition)

  • 설광원;이상룡
    • 대한기계학회논문집
    • /
    • 제13권2호
    • /
    • pp.287-298
    • /
    • 1989
  • 본 수치적 해석에서는 H$_{w}$/H$_{g}$의 비가 5.0~16.7의 범위에서 수행된 실험결과를 바탕으로 기존의 k-.epsilon. 난류모델을 사용하여, 고려하고자 하는 변수, 즉 유입유속, 입구 게이트의 높이, 수위, 배플의 유.무등에 따라서 액체의 유동형태가 어떻게 변하는가를 살펴 보고자 한다.다.

풍력 발전기 평가를 위한 수집 행렬 데이터 절감 알고리즘 개발 (Developing Novel Algorithms to Reduce the Data Requirements of the Capture Matrix for a Wind Turbine Certification)

  • 이제현;최정철
    • 신재생에너지
    • /
    • 제16권1호
    • /
    • pp.15-24
    • /
    • 2020
  • For mechanical load testing of wind turbines, capture matrix is constructed for various range of wind speeds according to the international standard IEC 61400-13. The conventional method wastes considerable amount of data by its invalid data policy -segment data into 10 minutes then remove invalid ones. Previously, we have suggested an alternative way to save the total amount of data to build a capture matrix, but the efficient selection of data has been still under question. The paper introduces optimization algorithms to construct capture matrix with less data. Heuristic algorithm (simple stacking and lowest frequency first), population method (particle swarm optimization) and Q-Learning accompanied with epsilon-greedy exploration are compared. All algorithms show better performance than the conventional way, where the distribution of enhancement was quite diverse. Among the algorithms, the best performance was achieved by heuristic method (lowest frequency first), and similarly by particle swarm optimization: Approximately 28% of data reduction in average and more than 40% in maximum. On the other hand, unexpectedly, the worst performance was achieved by Q-Learning, which was a promising candidate at the beginning. This study is helpful for not only wind turbine evaluation particularly the viewpoint of cost, but also understanding nature of wind speed data.

Optimal Control Policy for Replacements Involving Two Machines and One Repairman

  • Noh, Jang-Kab
    • 한국국방경영분석학회지
    • /
    • 제17권1호
    • /
    • pp.61-83
    • /
    • 1991
  • There has been a great deal of research dealing with the optimal replacement of stochastically deteriorating equipment and research in queueing systems with a finite calling population. However. there has been a lack of research which combines these two areas to deal with optimal replacement for a fixed number of machines and a limited number of repairmen. In this research, an optimal control policy for replacement involving two machines and one repairman is developed by investigating a class of age replacement policies in the context of controlling a G/M/1 queueing system with a finite calling population. The control policy to be imposed on this problem is an age-dependent control policy, described by the control limit $t^{\ast}$. The control limit is operational only when the repairman is idle; that is. if both machines are working, as soon as a machine reaches the age $t^{\ast}$ it is taken out of service for replacememt. We obtain the ${\epsilon}$-optimal control age which will minimize the long-run average system cost. An algorithm is developed that is applicable to general failure time distributions and cost functions. The algorithm does not require the condition of unimodality for implementation.

  • PDF

축류회전차 익말단 틈새유동에 대한 수치해석

  • 노수혁;조강래
    • 대한기계학회논문집B
    • /
    • 제22권3호
    • /
    • pp.336-345
    • /
    • 1998
  • The substantial loss behind axial flow rotor was generated by wake, various vortices in the hub region and the leakage vortex in the tip region. Particularly, the leakage vortex formed near blade tip was one of the main causes of the reduction of performance, the generation of noise and the aerodynamic vibration in rotor downstream. In this study, the three-dimensional flowfields in an axial flow rotor for various tip clearances were calculated, and the numerical results were compared with the experimental ones. The numerical technique was based on SIMPLE algorithm using standard k-.epsilon. model (WFM). Through calculations, the effects of the tip clearance on the overall performance of rotor and the loss distributions, and the increase in the displacement, momentum, and blade-force-deficit thickness of the casing wall boundary layer were investigated. The mass-averaged flow variables behind rotor agreed well with the experimental results. The presence of the tip leakage vortex behind rotor was described well. Although the loci of leakage vortex by calculation showed some differences compared with the experimental results, its behavior for various tip clearances was clarified by examining the loci of vortex center.