• Title/Summary/Keyword: State of Design

Search Result 7,584, Processing Time 0.039 seconds

Q-Learning Policy Design to Speed Up Agent Training (에이전트 학습 속도 향상을 위한 Q-Learning 정책 설계)

  • Yong, Sung-jung;Park, Hyo-gyeong;You, Yeon-hwi;Moon, Il-young
    • Journal of Practical Engineering Education
    • /
    • v.14 no.1
    • /
    • pp.219-224
    • /
    • 2022
  • Q-Learning is a technique widely used as a basic algorithm for reinforcement learning. Q-Learning trains the agent in the direction of maximizing the reward through the greedy action that selects the largest value among the rewards of the actions that can be taken in the current state. In this paper, we studied a policy that can speed up agent training using Q-Learning in Frozen Lake 8×8 grid environment. In addition, the training results of the existing algorithm of Q-learning and the algorithm that gave the attribute 'direction' to agent movement were compared. As a result, it was analyzed that the Q-Learning policy proposed in this paper can significantly increase both the accuracy and training speed compared to the general algorithm.

Estimation of the Economic Value of Pumped Storage Power Generation in Korea (양수발전의 비시장 가치 추정)

  • Won, DooHwan
    • Asia-Pacific Journal of Business
    • /
    • v.13 no.1
    • /
    • pp.263-275
    • /
    • 2022
  • Purpose - This study estimated the non-market value of pumped storage power generation using the contingent valuation method(CVM). Design/methodology/approach - CVM, a non-market value estimation method, was used. The perception of pumped storage power generation and the willingness to pay(WTP) for pumped storage power generation were investigated among 612 randomly selected households. Findings - It was analyzed that the average value per household was 7309.99 won/month, and the sources of these benefits were 1819.37 won due to the improvement of power generation efficiency, 1320.48 won due to the improvement of power system reliability, 2359.24 won due to the stabilization of electricity rates, 2110.89 won due to water resource management It was assumed that a circle occurred. If the average monthly benefit per household is expanded to cover countries across the country, it is estimated that the annual value to our society from pumped storage power generation will be KRW 1.796.6 trillion. Research implications or Originality - It is necessary to consider the operation of pumped-water power generation by reflecting the value of pumped-up power generation that is not evaluated in the market. Since Korea's electricity market is isolated in a state where it is impossible to connect with other countries, it may be vulnerable to a stable electricity operation system. Therefore, there is a need for a facility that can stably secure reserve power and produce power quickly when necessary. If pumped-water power generation is actively used for power operation, a more stable power system can be secured.

A Disk-based Archival Storage System Using the EOS Erasure Coding Implementation for the ALICE Experiment at the CERN LHC

  • Ahn, Sang Un;Betev, Latchezar;Bonfillou, Eric;Han, Heejune;Kim, Jeongheon;Lee, Seung Hee;Panzer-Steindel, Bernd;Peters, Andreas-Joachim;Yoon, Heejun
    • Journal of Information Science Theory and Practice
    • /
    • v.10 no.spc
    • /
    • pp.56-65
    • /
    • 2022
  • Korea Institute of Science and Technology Information (KISTI) is a Worldwide LHC Computing Grid (WLCG) Tier-1 center mandated to preserve raw data produced from A Large Ion Collider Experiment (ALICE) experiment using the world's largest particle accelerator, the Large Hadron Collider (LHC) at European Organization for Nuclear Research (CERN). Physical medium used widely for long-term data preservation is tape, thanks to its reliability and least price per capacity compared to other media such as optical disk, hard disk, and solid-state disk. However, decreasing numbers of manufacturers for both tape drives and cartridges, and patent disputes among them escalated risk of market. As alternative to tape-based data preservation strategy, we proposed disk-only erasure-coded archival storage system, Custodial Disk Storage (CDS), powered by Exascale Open Storage (EOS), an open-source storage management software developed by CERN. CDS system consists of 18 high density Just-Bunch-Of-Disks (JBOD) enclosures attached to 9 servers through 12 Gbps Serial Attached SCSI (SAS) Host Bus Adapter (HBA) interfaces via multiple paths for redundancy and multiplexing. For data protection, we introduced Reed-Solomon (RS) (16, 4) Erasure Coding (EC) layout, where the number of data and parity blocks are 12 and 4 respectively, which gives the annual data loss probability equivalent to 5×10-14. In this paper, we discuss CDS system design based on JBOD products, performance limitations, and data protection strategy accommodating EOS EC implementation. We present CDS operations for ALICE experiment and long-term power consumption measurement.

Analysis of the Shaft Resistance of a Pile Embedded in Sand Responding to Ground Deformation by Model Tests of Simulated Ground Heaving (실내모형실험을 통한 지반 융기시 사질토 지반에 매설된 지반 변형 대응형 말뚝의 주면 마찰 저항 분석)

  • Shin, Sehee;Lee, Kicheol
    • Journal of the Korean Geotechnical Society
    • /
    • v.39 no.1
    • /
    • pp.5-14
    • /
    • 2023
  • The pile driving process may lead to ground heaving, causing additional positive skin friction to act on the piles, compromising their stability. This study proposes a new pile foundation type that can reduce positive skin friction. This was investigated by designing and constructing a pile with a hydraulic cylinder which actively responds to ground deformation. The newly proposed pile design was compared against traditional piles in multiple model tests where ground heaving was simulated. In the tests, base load and total shaft resistance were measured during ground heaving and with expansion of the hydraulic cylinder. As a result of the tests, a very small amount of expansion of the hydraulic cylinder member completely reduced the positive skin friction and increased the base load. Excessive expansion of the hydraulic cylinder, however, generates negative skin friction beyond the zero skin friction state. Therefore, it is necessary to estimate the appropriate level of hydraulic cylinder expansion, taking into account the amount of ground heaving and the allowable displacement of the pile.

Degradation Mechanisms of a Li-S Cell using Commercial Activated Carbon

  • Norihiro Togasaki;Aiko Nakao;Akari Nakai;Fujio Maeda;Seiichi Kobayashi;Tetsuya Osaka
    • Journal of Electrochemical Science and Technology
    • /
    • v.14 no.4
    • /
    • pp.361-368
    • /
    • 2023
  • In lithium-sulfur (Li-S) batteries, encapsulation of sulfur in activated carbon (AC) materials is a promising strategy for preventing the dissolution of lithium polysulfide into electrolytes and enhancing cycle life, because instead of solid-liquid-solid reactions, quasi-solid-state (QSS) reactions occur in the AC micropores. While a high weight fraction of sulfur in S/AC composites is essential for achieving a high energy density of Li-S cells, the deterioration mechanisms under such conditions are still unclear. In this study, we report the deterioration mechanisms during charge-discharge cycling when the discharge products overflow from the AC. Analysis using scanning electron microscopy and energy-dispersive X-ray spectrometry confirms that the sulfur in the S/AC composites migrates outside the AC as cycling progresses, and it is barely present in the AC after 20 cycles, which corresponds to the capacity decay of the cell. Impedance analysis clearly shows that the electrical resistance of the S/AC composite and the charge-transfer resistance of QSS reactions significantly increase as a result of sulfur migration. On the other hand, the charge-discharge cycling performance under limited-capacity conditions, where the discharge products are encapsulated inside the AC, is extremely stable. These results reveal the degradation mechanism of a Li-S cell with micro-porous carbon and provide crucial insights into the design of a S/AC composite cathode and its operating conditions needed to achieve stable cycling performance.

Process Modeling System of a Combined Cycle Plant for Steady State Simulation with Model Based Approach (수학적 모델링 방법에 기초한 복합발전 공정의 정상상태 모사시스템 개발)

  • Kim, Shin Hyuk;Hwang, Lee Si;Joo, Yong Jin;Lee, Sang Uk;Shon, Byung Mo;Oh, Min
    • Korean Chemical Engineering Research
    • /
    • v.53 no.5
    • /
    • pp.545-552
    • /
    • 2015
  • Process modeling and simulation is a powerful methodology to quantitatively predict the change of process variables when operating and design conditions are changed. In this study, considering drawbacks of currently used process simulator for combined cycle plants, we developed process modeling system equipped with an ease of use and flexibility for model development. For this purpose, the analysis of combined cycle processes was carried out and consequently, mathematical models and libraries were developed. Furthermore, in view of the fact that the level of the abstraction of process models depends on the purpose of simulation as well as the available data, simple and rigorous models were also developed for some important units. In use of reference combined plant, we executed process simulation using the developed modeling system and the comparison was made between the results of simulation and the reference data. Less than 1% marginal error was identified and we concluded that the modeling system can be applied for commercial combined cycle processes.

A Study on a Wind Turbine Data Logger System based on WiFi for Meteorological Resource Measurement (기상자원 측정을 위한 와이파이 기반의 풍력용 데이터로거 시스템에 관한 연구)

  • Jung, Se-Hoon;Sim, Chun-Bo
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.10 no.1
    • /
    • pp.55-64
    • /
    • 2015
  • Wind turbine market is showed height growth rate of about 30% for year, and is increasingly growing. Total rate of domestic wind turbine installation is showing share of 0.2% of the global market that is 380MW. However, wind turbine installed in domestic are foreign product more than 90%. Similarly, Datalogger of pretest system for ocean wind turbine plant installation has been leaked huge cost to abroad by mostly abroad company product. In this paper, we proposed pretest weather resource measurement system for efficiency and investment cost cutting of wind turbine construction work. Preset weather resource measurement system is ocean weather resource measurement datalogger based on wireless communication(wifi) that have consist of hardware and software(wind rose) that is able to monitoring as datalogger of wireless bridge and battery state, wind direction, wind speed, temperature, humidity, radiation around weather tower and is able to analysis of measured data.

Experimental Study on Millimeter Scale Two Phase Catalytic Reactor (밀리미터 스케일의 이상 분해 반응기에 대한 실험적 연구)

  • Cho, Chung-Hun;Lee, Dae-Hoon;Kwon, Se-JIn
    • Transactions of the Korean Society of Mechanical Engineers B
    • /
    • v.28 no.3
    • /
    • pp.265-270
    • /
    • 2004
  • Experiment study on a down scaled two-phase catalytic reactor is presented. As a preliminary step for the development of catalytic reactor, nano-particulate catalyst was prepared. Perovskite La$\_$0.8/Sr$\_$0.2/CoO$_3$is chosen and synthesized as a catalyst considering superior catalytic performance in reduction and oxidation process where oxygen is involved among the reagent. Reactor that has a scale of 2${\times}$10${\times}$25mm was made by machining of A1 block as a layered structure considering further extension to micro-machining. Hydrogen peroxide of 70wt% was adopted as reactant and was provided to the reactor loaded with 1.5 g of catalyst. Reactant flow rate was varied by precision pump with a range of 0.15cc/min to 17.2cc/min. Temperature distribution within reactor was recorded by 3 thermocouples and total amount of liquid product was measured. Temperature distribution and factors that affect temperature were observed and relation between temperature distribution and production rate was also analyzed. Relative time scale plays a significant role in the performance of the reactor. To obtain steady state operation, appropriate ratio of flow rate, catalyst mass and reactor geometry is required and furthermore to get more efficient production rate temperature distribution should be evenly distributed. The database obtained by the experiment will be used as a design parameter for micro reactor.

Robust High-Gain Observer Based SOC Estimator for Uncertain RC Model of Li-Ion Batteries (불확실성을 갖는 RC 모델 기반의 리튬이온 배터리 SOC 추정을 위한 강인한 고이득 관측기 설계)

  • Lee, Jong-Yeon;Kim, Wonho;Hyun, Chang-Ho
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.23 no.3
    • /
    • pp.214-219
    • /
    • 2013
  • This paper proposes the robust high-gain observer based SOC estimatro for uncertain RC model of Li-Ion batteries. In general, RC battery model has inevitable uncertainties and it cause some negative effect to estimate the accurate SOC of Li-Ion batteries. The proposed estimator overcomes such weakness with two techniques; high-gain observer design technique and sliding mode control technique. A high-gain observer provides the robustness against model uncertainties to the proposed estimator. A sliding mode control technique helps the proposed estimator by reducing the side effect of adopting a high-gain observer such as peaking phenomenon and perturbation. The performance of the proposed estimator is verified by some simulation.

An Analysis of Research Related to the Massage as the Nursing Intervention (간호중재로서의 마사지 적용연구 분석)

  • Ji, Eun-Sun;Cho, Kyoul-Ja
    • Korean Parent-Child Health Journal
    • /
    • v.7 no.2
    • /
    • pp.168-181
    • /
    • 2004
  • Purpose: The purpose of this study was to identified patterns of studies and to analyze the nursing research related to the massage intervention in Korea and to improve direction of nursing research in massage intervention in Korea. Methods: The research studies related to the massage were selected from the Korean Nurses Academic Society Journal and dissertation which were conducted experimental research design the last 7 years in Korea. The total numbers of the studies were 58. Result: The study subjects were post operational state in 34.5%, healthy adult in 17.2% studies. The others dealt with infant, cancer, dementia, hypertension, preterm neonates, elderly. Types of massage were whole body in 31.1%, foot in 22.6%, hand in 17.2%, back in 13.8% studies. And Meridian massage in 17.2%. Length of massage was below 5 minutes in 17.2%, 6~10 minutes in 29.4% and 11~20 minutes in 32.8% studies. Frequency of massage was only 1 time in 25.9%, 2~5 times in 31.1% studies. Massage produced psychological and physiological effects. Positive psychologic effects were anxiety relief, pain relief, mood enhancement and fatigue relief. Positive physiologic effects on body systems were blood pressure, heart rate, edema, skin temperature, immune system, blood glucose, excretion, PMS syndrome and growth and development. Conclusion: As a result, effects of massage were almost positive. Therefore massage is useful alternative nursing intervention. But more attention research is needed to identify the objectivity instrument to measure and repeat research.

  • PDF