• Proceedings of the Korea Water Resources Association Conference
• /
• 2023.05a
• /
• pp.229-229
• /
• 2023

강화학습은 에이전트(agent)가 주어진 환경(environment)과의 상호작용을 통해서 상태(state)를 변화시켜가며 최대의 보상(reward)을 얻을 수 있도록 최적의 행동(action)을 학습하는 기계학습법을 의미한다. 최근 알파고와 같은 게임뿐만 아니라 자율주행 자동차, 로봇 제어 등 다양한 분야에서 널리 사용되고 있다. 상수도관망 분야의 경우에도 펌프 운영, 밸브 운영, 센서 최적 위치 선정 등 여러 문제에 적용되었으나, 설계에 강화학습을 적용한 연구는 없었다. 설계의 경우, 관망의 크기가 커짐에 따라 알고리즘의 탐색 공간의 크기가 증가하여 기존의 최적화 알고리즘을 이용하는 것에는 한계가 존재한다. 따라서 본 연구는 강화학습을 이용하여 상수도관망의 구성요소와 환경요인 간의 복잡한 상호작용을 고려하는 설계 방법론을 제안한다. 모델의 에이전트를 딥 강화학습(Deep Reinforcement Learning)으로 구성하여, 상태 및 행동 공간이 커 발생하는 고차원성 문제를 해결하였다. 또한, 해당 모델의 상태 및 보상으로 절점에서의 압력 및 수요량과 설계비용을 고려하여 적절한 수량과 수압의 용수 공급이 가능한 경제적인 관망을 설계하도록 하였다. 모델의 행동은 실제로 공학자가 설계하듯이 절점마다 하나씩 차례대로 다른 절점과의 연결 여부를 결정하는 것으로, 이를 통해 관망의 레이아웃(layout)과 관경을 결정한다. 본 연구에서 제안한 방법론을 규모가 큰 그리드 네트워크에 적용하여 모델을 검증하였으며, 고려해야 할 변수의 개수가 많음에도 불구하고 목적에 부합하는 관망을 설계할 수 있었다. 모델 학습과정 동안 에피소드의 평균 길이와 보상의 크기 등의 변화를 비교하여, 제안한 모델의 학습 능력을 평가 및 보완하였다. 향후 강화학습 모델을 통해 신뢰성(reliability) 또는 탄력성(resilience)과 같은 시스템의 성능까지 고려한 설계가 가능할 것으로 기대한다.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.18 no.1
• /
• pp.45-52
• /
• 2023

The power generation method using expensive diesel has operation problems such as high cost diesel generator and a lack of reserved power due to increase of power demand in some islands, requiring expansion of power generation facilities. To solve this problems, it is necessary to improve the efficiency of power generation facilities through an ORC(Organic Rankin Cycle) system application that uses waste heat as a heat source. Therefore, localized application technology of price competitive and highly reliable ORC power generation system is needed, and optimization technology of generators is having great effect, so this study performed two generator designs to get a high-efficiency generator with an optimized 30kW output. The comparison of simulation data for two designed models showed that a generator with SPM factor of 46.2% had an efficiency of 92.1% and a power ouput of about 23.2kW based on 12,000rpm, a generator with SPM factor of 44.46%, had a power output of 27.9kW and efficiency of 93.6% based on above rpm. For the verification of improved design model with SPM factor of 44.46%, the prototype test system with 110kW motor dynamometer was installed and got to the efficiency of 92.08% with conditions of the rated capacity 25kW at 12,000rpm, the test results of prototype generator showed the validity of generator design.

• The Journal of Korean Institute of Electromagnetic Engineering and Science
• /
• v.29 no.6
• /
• pp.473-476
• /
• 2018

Herein, a $2{\times}2$ subarray antenna is designed to implement a VHF band active electronically scanned array. The Yagi-Uda antenna is used as a radiating element. The bandwidth enhancement and miniaturization of the Yagi-Uda antenna are achieved by optimizing the diameter of a driven element and the length of a director. In addition, the grid reflector is utilized to improve the front-to-back ratio(FBR) and to reduce both the wind resistance and overall system weight. The fabricated $2{\times}2$ subarray antenna fully covers the VHF target band($0.98{\sim}1.02f_c$). The measured maximum gain is 10.61 dBi and the FBR is larger than 26 dB.

• The Journal of The Korea Institute of Intelligent Transport Systems
• /
• v.8 no.2
• /
• pp.149-157
• /
• 2009

Tracking technologies which provide real-time and customized information through various information collecting and processing for pedestrians who use traffic connective and transferring center have been being examined. However some problems are caused due to the wide-range positioning error for some services as device installation and service place. It is also difficult to be applied to traffic linkage and transfer services because many situations can be barren. In the testbed, Gwangmyoung Station, we got some results in bad conditions such as a lot of steel construction and another communication device. Practically, conditions of the place which will be built can be worse than Gwangmyoung station. Therefore, we researched suitable Location correction algorithm as a method for accuracy to traffic connective and transferring system. And its algorithm is designed through grid coordinates, map-matching, modeling coordinates and Kalman filtering and is being implemented continuously. Also preparing for optimization of various transferring center model, we designed for simulator type algorithm what is available for deciding algorithm factor.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.37B no.12
• /
• pp.1113-1118
• /
• 2012

Smart grid and intelligent transportation system draw significant interest since they are considered as one of the green technologies. These systems require a large number of sensors, actuators, and controllers. Also, machine-to-machine (M2M) communications is important because of the automatic control. The LTE-Advanced networks is preparing a set of functions that facilitate the M2M communications, and particularly the development of an efficient call admission control mechanism is critical. A method that groups MTC devices according to QoS constraints and determines the admission depending on the QoS satisfaction is limitedly applied only if the data transmission period and the maximum delay are identical. This paper proposed a call admission control that is free from such limitation and also optimizes the admission process under the certain condition of the transmission period and maximum delay. The theorems regarding the proposed method are presented with the proofs. The simulations confirms its validity and shows it is better in call admission probability than existing works.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.17 no.2
• /
• pp.279-290
• /
• 2022

A superconducting fault current limiter(SFCL) is a power device that exploits superconducting transition to control currents and enhances the flexibility, stability and reliability of the power system within a few milliseconds. With a high phase transition speed, high critical current densities and little AC loss, high-temperature superconducting (HTS) wires are suitable for a resistive-type SFCL. However, HTS wires due to the lack of optimization research are rather inefficient to directly apply to a fault current limiter in terms of the design and capacity, for the existing method relied the characteristics. Therefore, in order to develop a suitable wire for an SFCL, it is necessary to enhance critical current uniformity, select optimal stabilizer materials and conducted research on the development of uniform stabilizer layering technology. The high temperature superconducting wires manufactured by this study get an average critical current of 804 A/12mm-width at the length of 710m; therefore, conducted research was able to secure economic performance by improving efficiency, reducing costs, and reducing size.

• The Journal of the Convergence on Culture Technology
• /
• v.9 no.5
• /
• pp.569-582
• /
• 2023

Lead-acid Battery is the oldest rechargeable battery system and has maintained its position in the rechargeable battery field. The battery causes thermal runaway for various reasons, which can lead to major accidents. Therefore, preventing thermal runaway is a key part of the battery management system. Recently, research is underway to categorize thermal runaway battery cells into machine learning. In this paper, we present a thermal runaway hazard cell detection and verification algorithm using DBSCAN and statistical method. An experiment was conducted to classify thermal runaway hazard cells using only the resistance values as measured by the Battery Management System (BMS). The results demonstrated the efficacy of the proposed algorithms in accurately classifying thermal runaway cells. Furthermore, the proposed algorithm was able to classify thermal runaway cells between thermal runaway hazard cells and cells containing noise. Additionally, the thermal runaway hazard cells were early detected through the optimization of DBSCAN parameters using a grid search approach.

• Journal of Korean Tunnelling and Underground Space Association
• /
• v.19 no.1
• /
• pp.11-27
• /
• 2017

The road network system of major domestic urban areas such as city of Seoul was rapidly developed and regionally expanded. In addition, many kinds of life-lines such as electrical cables, telephone cables, water&sewerage lines, heat&cold conduits and gas lines were needed in order for urban residents to live comfortably. Therefore, most of the life-lines were individually buried in underground and individually managed. The utility tunnel is defined as the urban planning facilities for commonly installing life-lines in the National Land Planning Act. Expectation effectiveness of urban utility tunnels is reducing repeated excavation of roads, improvement of urban landscape; road pavement durability; driving performance and traffic flow. It can also be expected that ensuring disaster safety for earthquakes and sinkholes, smart-grind and electric vehicle supply, rapid response to changes in future living environment and etc. Therefore, necessity of urban utility tunnels has recently increased. However, all of the constructed utility tunnels are cut-and-cover tunnels domestically, which is included in development of new-town areas. Since urban areas can not accommodate all buried life-lines, it is necessary to study the feasibility assessment system for utility tunnel by urban patterns and capacity optimization for urban utility tunnels. In this study, we break away from the new-town utility tunnels and suggest a quantitative assessment model based on the evaluation index for urban areas. In addition, we also develop a program that can implement a quantitative evaluation system by subdividing the feasibility assessment system of urban patterns. Ultimately, this study can contribute to be activated the urban utility tunnel.

• Journal of Biomedical Engineering Research
• /
• v.25 no.4
• /
• pp.253-259
• /
• 2004

in this study, we developed a Monte Carlo imaging simulation code written by the visual C$\^$++/ programing language for design optimization of a digital X-ray imaging system. As a digital X-ray imaging system, we considered a Gd$_2$O$_2$S(Tb) scintillator and a photosensor array, and included a 2D parallel grid to simulate general test renditions. The interactions between X-ray beams and the system structure, the behavior of lights generated in the scintillator, and their collection in the photosensor array were simulated by using the Monte Carlo method. The scintillator thickness and the photosensor array pitch were assumed to 66$\mu\textrm{m}$ and 48$\mu\textrm{m}$, respertively, and the pixel format was set to 256 x 256. Using the code, we obtained X-ray images under various simulation conditions, and evaluated their image qualities through the calculations of SNR (signal-to-noise ratio), MTF (modulation transfer function), NPS (noise power spectrum), DQE (detective quantum efficiency). The image simulation code developed in this study can be applied effectively for a variety of digital X-ray imaging systems for their design optimization on various design parameters.

• The KIPS Transactions:PartD
• /
• v.11D no.4
• /
• pp.983-990
• /
• 2004

Multiple-count problem is occurred when rectangle objects span across several buckets. The CD histogram is a technique which selves this problem by keeping four sub-histograms corresponding to the four points of rectangle. Although It provides exact results with constant response time, there is still a considerable issue. Since it is based on a query window which aligns with a given grid, a number of errors nay be occurred when it is applied to real applications. In this paper, we propose selectivity estimation techniques using the generalized cumulative density histogram based on two probabilistic models : \circled1 probabilistic model which considers the query window area ratio, \circled2 probabilistic model which considers intersection area between a given grid and objects. Our method has the capability of eliminating an impact of the restriction on query window which the existing cumulative density histogram has. We experimented with real datasets to evaluate the proposed methods. Experimental results show that the proposed technique is superior to the existing selectivity estimation techniques. Furthermore, selectivity estimation technique based on probabilistic model considering the intersection area is very accurate(less than 5% errors) at 20% query window. The proposed techniques can be used to accurately quantify the selectivity of the spatial range query on rectangle objects.