• 제목/요약/키워드: reinforcement pattern

검색결과 224건 처리시간 0.022초

지역 투자 정책을 이용한 강화학습 기반 동적 자산 할당 기법 (A Dynamic Asset Allocation Method based on Reinforcement learning Exploiting Local Traders)

  • 오장민;이종우;장병탁
    • 한국정보과학회논문지:소프트웨어및응용
    • /
    • 제32권8호
    • /
    • pp.693-703
    • /
    • 2005
  • 본 논문에서는 패턴 기반의 다수의 주가 예측 모델에 기반한 지역 투자자의 효율적인 결합을 통해, 거래 성능을 최대화 할 수 있는 동적 자산 할당 기법을 연구하였다. 각 예측 모델이 추천한 후보 종목에 효과적인 거래 대금 비율을 할당하는 메타 정책(meta policy)이라는 자산 할당 정책을 강화 학습 틀내에서 정의하였다. 이를 위해 각 예측 모델의 추천 종목 수와 전체 자산 대비 주식 자금 비율을 동시에 활용하는 상태 공간을 설계하였다. 대한민국 주식 시장에 대한 시뮬레이션 실험을 통해, 본 논문에서 제안한 자산 할당 정책은 기존의 고정 자산 할당 방법들에 비해 우수한 성능을 보임을 제시 하였다. 이는 강화학습을 통한 지역 투자자의 결합을 통해 의사 결정 문제에서 감독자 학습 기법으로 학습된 예측 모델의시너지 효과를 거둘 수 있음을 의미한다.

Sustainable Smart City Building-energy Management Based on Reinforcement Learning and Sales of ESS Power

  • Dae-Kug Lee;Seok-Ho Yoon;Jae-Hyeok Kwak;Choong-Ho Cho;Dong-Hoon Lee
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제17권4호
    • /
    • pp.1123-1146
    • /
    • 2023
  • In South Korea, there have been many studies on efficient building-energy management using renewable energy facilities in single zero-energy houses or buildings. However, such management was limited due to spatial and economic problems. To realize a smart zero-energy city, studying efficient energy integration for the entire city, not just for a single house or building, is necessary. Therefore, this study was conducted in the eco-friendly energy town of Chungbuk Innovation City. Chungbuk successfully realized energy independence by converging new and renewable energy facilities for the first time in South Korea. This study analyzes energy data collected from public buildings in that town every minute for a year. We propose a smart city building-energy management model based on the results that combine various renewable energy sources with grid power. Supervised learning can determine when it is best to sell surplus electricity, or unsupervised learning can be used if there is a particular pattern or rule for energy use. However, it is more appropriate to use reinforcement learning to maximize rewards in an environment with numerous variables that change every moment. Therefore, we propose a power distribution algorithm based on reinforcement learning that considers the sales of Energy Storage System power from surplus renewable energy. Finally, we confirm through economic analysis that a 10% saving is possible from this efficiency.

침입탐지시스템의 정확도 향상을 위한 개선된 데이터마이닝 방법론 (Reinforcement Data Mining Method for Anomaly&Misuse Detection)

  • 최윤정
    • 디지털산업정보학회논문지
    • /
    • 제6권1호
    • /
    • pp.1-12
    • /
    • 2010
  • Recently, large amount of information in IDS(Intrusion Detection System) can be un manageable and also be mixed with false prediction error. In this paper, we propose a data mining methodology for IDS, which contains uncertainty based on training process and post-processing analysis additionally. Our system is trained to classify the existing attack for misuse detection, to detect the new attack pattern for anomaly detection, and to define border patter between attack and normal pattern. In experimental results show that our approach improve the performance against existing attacks and new attacks,from 0.62 to 0.84 about 35%.

An Adaptive Multi-Echelon Inventory Control Model for Nonstationary Demand Process

  • Na, Sung-Soo;Jun, Jin;Kim, Chang-Ouk
    • 한국경영과학회:학술대회논문집
    • /
    • 대한산업공학회/한국경영과학회 2004년도 춘계공동학술대회 논문집
    • /
    • pp.441-445
    • /
    • 2004
  • In this paper, we deal with an inventory model of a multi-stage, serial supply chain system where a single product type and nonstationary customer demand pattern are considered. The retailer and suppliers place their orders according to an echelon-stock based replenishment control policy. We assume that the suppliers can access online information on the demand history and use this information when making their replenishment decisions. Using a reinforcement learning technique, the inventory control parameters are designed to adaptively change as the customer demand pattern is altered, in order to maintain a given target service level. Through a simulation based experiment, we verified that our approach is good for maintaining the target service level.

  • PDF

위상최적화 기법을 이용한 반도체 공정용 압력방폭형 외함 도어의 보강 패턴 최적화 (Topology Optimization of Reinforcement Pattern for Pressure-Explosion Proof Enclosure Door in Semiconductor Manufacturing Process )

  • 김영상;신동석;전의식
    • 반도체디스플레이기술학회지
    • /
    • 제22권2호
    • /
    • pp.56-63
    • /
    • 2023
  • This paper presents a method using finite element analysis and topology optimization to address the issue of overdesign in pressure-explosion proof enclosure doors for semiconductor manufacturing processes. The design conducted in this paper focuses on the pattern design of the enclosure door and its fixation components. The process consists of a solid-filled model, a topology optimization model, and a post-processing model. By applying environmental conditions to each model and comparing the maximum displacement, maximum equivalent stress, and weight values, it was confirmed that a reduction of about 13% in weight is achievable.

  • PDF

Experimental study on shear performance of partially precast Castellated Steel Reinforced Concrete (CPSRC) beams

  • Yang, Yong;Yu, Yunlong;Guo, Yuxiang;Roeder, Charles W.;Xue, Yicong;Shao, Yongjian
    • Steel and Composite Structures
    • /
    • 제21권2호
    • /
    • pp.289-302
    • /
    • 2016
  • A new kind of partially precast or prefabricated castellated steel reinforced concrete beam, which is abbreviated here as CPSRC beam, was presented and introduced in this paper. This kind of CPSRC beam is composed of a precast outer-part and a cast-in-place inner-part. The precast outer-part is composed of an encased castellated steel shape, reinforcement bars and high performance concrete. The cast-in-place inner-part is made of common strength concrete, and is casted with the floor slabs simultaneously. In order to investigate the shear performance of the CPSRC beam, experiments of six CPSRC T-beam specimens, together with experiments of one cast-in-place SRC control T-beam specimen were conducted. All the specimens were subjected to sagging bending moment (or positive moment). In the tests, the influence of casting different strength of concrete in the cross section on the shear performance of the PPSRC beam was firstly emphasized, and the effect of the shear span-to-depth ratio on that were also especially taken into account too. During the tests, the shear force-deflection curves were recorded, while the strains of concrete, the steel shapes as well as the reinforcement stirrups at the shear zone of the specimens were also measured, and the crack propagation pattern together with the failure pattern was as well observed in detail. Based on the test results, the shear failure mechanism was clearly revealed, and the effect of the concrete strength and shear span-to-depth ratios were investigated. The shear capacity of such kind of CPSRC was furthermore discussed, and the influences of the holes on the steel shape on the shear performance were particularly analyzed.

PDA를 이용한 터널막장면 정보처리시스템 개발 (Automation of tunnel face mapping using PDA)

  • 이준석;이현석;김종규;이상수
    • 한국터널지하공간학회 논문집
    • /
    • 제7권1호
    • /
    • pp.89-96
    • /
    • 2005
  • 사회 전반에 걸친 디지털 혁명에 따라 IT를 기반으로 하는 다양한 정보화 터널시공기법이 개발되고 있으며 터널시공시 의사결정체계의 일환으로 적용되고 있다. 따라서 본 연구에서는 PDA를 이용한 터널시공의 정보화에 대하여 기술하였으며, 특히 시공중 발생하는 각종 막장면 데이터를 실시간으로 입 출력 및 저장하고 이를 기반으로 지보패턴을 결정할 수 있는 의사결정체계를 구축하였다. 이를 위하여 무선 네트워크, 이동식 컴퓨터, CDMA 및 디지털카메라 등 최근 정보통신을 바탕으로 한 막장면 매핑자료의 실시간 데이터 수집 및 해석, 디지털 매핑등이 가능한 PDA용 S/W를 개발하였으며 현장적용에 대하여 고려하였다. 향후에는 실제 시공시 사용된 지보방법 및 소요 지보량을 함께 저장할 수 있는 DB를 구축하는 한편 현장적용을 통한 feedback 결과에 대하여 연구가 지속될 예정이다.

  • PDF

콘크리트 보강용 FRP 보강근의 표면형상 변화에 따른 부착 특성 (Bond Performance of FRP Reinforcing Bar by Geometric Surface Change)

  • 박찬기;원종필
    • 한국농공학회논문집
    • /
    • 제46권5호
    • /
    • pp.69-77
    • /
    • 2004
  • FRP rebar has low bond performance than steel rebar. Usually, FRP rebar has about 60% of bond strength of steel rebar. Without adequate bond to concrete, the full composite action between reinforcement and concrete matrix can not be achieved. Therefore, FRP rebars must also have surface deformations that provide good bond to concrete. The purpose of this research was decided an optimum surface deformation patterns through bond test of FRP rebar. Eighteen surface deformation patterns of FRP rebar with widely different geometries were investigated. Based on the test results, we established optimum surfale deformation pattern. Bond tests were performed for three types of surface deformation patterns of FRP rebar including sand coated rebar, ribbed rebar, and wrapped and sand coated rebar that commercially available, and two types of FRP rebar including CFRP, GFRP rebars that optimum surface deformation pattern is applied. According to bond test results, FRP rebars that optimum surface deformation pattern is applied were found to have better bond strength with concrete than currently using FRP rebar.

Experimental study on long-term behavior of RC columns subjected to sustained eccentric load

  • Kim, Chang-Soo;Gong, Yu;Zhang, Xin;Hwang, Hyeon-Jong
    • Advances in concrete construction
    • /
    • 제9권3호
    • /
    • pp.289-299
    • /
    • 2020
  • To investigate the long-term behavior of eccentrically loaded RC columns, which are more realistic in practice than concentrically loaded RC columns, long-term eccentric loading tests were conducted for 10 RC columns. Test parameters included concrete compressive strength, reinforcement ratio, bar yield strength, eccentricity ratio, slenderness ratio, and loading pattern. Test results showed that the strain and curvature of the columns increased with time, and concrete forces were gradually transferred to longitudinal bars due to the creep and shrinkage of concrete. The long-term behavior of the columns varied with the test parameters, and long-term effects were more pronounced in the case of using the lower strength concrete, lower strength steel, lower bar ratio, fewer loading-step, higher eccentricity ratio, and higher slenderness ratio. However, in all the columns, no longitudinal bars were yielded under service loads at the final measuring day. Meanwhile, the numerical analysis modeling using the ultimate creep coefficient and ultimate shrinkage strain measured from cylinder tests gave quite good predictions for the behavior of the columns.

FRP를 이용한 사면보강 (The Slope Reinforcement by use of FRP)

  • 이상덕;권오엽;최용기
    • 한국지반공학회:학술대회논문집
    • /
    • 한국지반공학회 2000년도 사면안정 학술발표회
    • /
    • pp.155-180
    • /
    • 2000
  • The pattern of domestic slope construction has been steadily changed from the simpled and small-scale to the large-scale and complicated one, frequently near the existing structures, as the density of population and the traffic increases. In some cases, the slopes become steeper and larger due to the road improvement and construction. For the rock slope, the existence of discontinuity cannot be disregarded and acts as an important factor on the slope stability. Most of the existing methods for stabilizing the slope were focused on reducing the slope angle. Under the specific geographic condition, it is necessary to concentrate more efforts on the research and development of supporting system for the slope stability. As a supporting system, it is often very advantageous to use the FRP pipe grouting method that is similar to the existing soil nailing method or the rock bolting method but uses the high strength FRP pipe as a principal reinforcement in place of steel bar. Through the FRP pipe, the grout material can be injected into the rock mass to improve its shear strength to the required value. .In this study, the characteristics of FRP are investigated by the laboratory tests and the field tests. And, the practical aspects of FRP method are reviewed and analyzed.

  • PDF