• KIPS Transactions on Software and Data Engineering
• /
• v.11 no.3
• /
• pp.141-148
• /
• 2022

Recently, reinforcement learning combined with deep neural network technology has achieved remarkable success in various fields such as board games such as Go and chess, computer games such as Atari and StartCraft, and robot object manipulation tasks. However, such deep reinforcement learning describes states, actions, and policies in vector representation. Therefore, the existing deep reinforcement learning has some limitations in generality and interpretability of the learned policy, and it is difficult to effectively incorporate domain knowledge into policy learning. On the other hand, dNL-RRL, a new relational reinforcement learning framework proposed to solve these problems, uses a kind of vector representation for sensor input data and lower-level motion control as in the existing deep reinforcement learning. However, for states, actions, and learned policies, It uses a relational representation with logic predicates and rules. In this paper, we present dNL-RRL-based policy learning for transportation mobile robots in a manufacturing environment. In particular, this study proposes a effective method to utilize the prior domain knowledge of human experts to improve the efficiency of relational reinforcement learning. Through various experiments, we demonstrate the performance improvement of the relational reinforcement learning by using domain knowledge as proposed in this paper.

• Proceedings of the Korea Water Resources Association Conference
• /
• 2023.05a
• /
• pp.30-30
• /
• 2023

This study aims to establish the multi-reservoir operation system model in the Upper Mun River Basin which includes 5 main dams namely, Mun Bon (MB), Lamchae (LC), Lam Takhong (LTK), Lam Phraphoeng (LPP), and Lower Lam Chiengkrai (LLCK) Dams. The knowledge and AI technology were applied aiming to develop innovative prototype for SMART dam-reservoir operation in future. Two different sorts of reservoir operation system model namely, Fuzzy Logic (FL) and Constraint Programming (CP) as well as the development of rainfall and reservoir inflow prediction models using Machine Learning (ML) technique were made to help specify the right amount of daily reservoir releases for the Royal Irrigation Department (RID). The model could also provide the essential information particularly for the Office of National Water Resource of Thailand (ONWR) to determine the short-term and long-term water resource management plan and strengthen water security against flood and drought in this region. The simulated results of base case scenario for reservoir operation in the Upper Mun from 2008 to 2021 indicated that in the same circumstances, FL and CP models could specify the new release schemes to increase the reservoir water storages at the beginning of dry season of approximately 125.25 and 142.20 MCM per year. This means that supplying the agricultural water to farmers in dry season could be well managed. In other words, water scarcity problem could substantially be moderated at some extent in case of incapability to control the expansion of cultivated area size properly. Moreover, using AI technology to determine the new reservoir release schemes plays important role in reducing the actual volume of water shortfall in the basin although the drought situation at LTK and LLCK Dams were still existed in some periods of time. Meanwhile, considering the predicted inflow and hydrologic factors downstream of 5 main dams by FL model and minimizing the flood volume by CP model could ensure that flood risk was considerably minimized as a result of new release schemes.

• Journal of the Korea Society for Simulation
• /
• v.19 no.2
• /
• pp.73-80
• /
• 2010

A wireless sensor network which is deployed in hostile environment can be easily compromised by attackers. The selective forwarding attack can jam the packet or drop a sensitive packet such as the movement of the enemy on data flow path through the compromised node. Xiao, Yu and Gao proposed the checkpoint-based multi-hop acknowledgement scheme(CHEMAS). In CHEMAS, each path node enable to be the checkpoint node according to the pre-defined probability and then can detect the area where the selective forwarding attacks is generated through the checkpoint nodes. In this scheme, the number of hops is very important because this parameter may trade off between energy conservation and detection capacity. In this paper, we used the fuzzy rule system to determine adaptive threshold value which is the number of hops for the ACK packets. In every period, the base station determines threshold value while using fuzzy logic. The energy level, the number of compromised node, and the distance to each node from base station are used to determine threshold value in fuzzy logic.

• Journal of the Institute of Electronics Engineers of Korea TC
• /
• v.40 no.11
• /
• pp.51-62
• /
• 2003

This paper presents a novel survivor memeory management and decoding techniques with sequential backward state transition control in the trace back Viterbi decoder. The Viterbi algorithm is an maximum likelihood decoding scheme to estimate the likelihood of encoder state for channel error detection and correction. This scheme is applied to a broad range of digital communication such as intersymbol interference removing and channel equalization. In order to achieve the area-efficiency VLSI chip design with high throughput in the Viterbi decoder in which recursive operation is implied, more research is required to obtain a simple systematic parallel ACS architecture and surviver memory management. As a method of solution to the problem, this paper addresses a progressive decoding algorithm with sequential backward state transition control in the trace back Viterbi decoder. Compared to the conventional trace back decoding techniques, the required total memory can be greatly reduced in the proposed method. Furthermore, the proposed method can be implemented with a simple pipelined structure with systolic array type architecture. The implementation of the peripheral logic circuit for the control of memory access is not required, and memory access bandwidth can be reduced Therefore, the proposed method has characteristics of high area-efficiency and low power consumption with high throughput. Finally, the examples of decoding results for the received data with channel noise and application result are provided to evaluate the efficiency of the proposed method.

• Journal of Digital Convergence
• /
• v.12 no.10
• /
• pp.337-343
• /
• 2014

The PRT(Personal Rapid Transit) in material or immaterial guided tracks is operated automatically according to the needs of passengers with the optimal non-stop path from the source to the destination. In recent years, the personal rapid transit (PRT) system, which affords superior accessibility and ease of use, has been spotlighted as a new transport system for the future. In this study, a method for vertical lifting of PRT vehicles was proposed to facilitate interlink with other means of transport and thereby improve the efficiency of door-to-door transport. For this purpose, operation control interfaces were designed and experiments were conducted. Programmable Logic Controller (PLC) dedicated for the PRT vertical lift was designed to interface with Operation Control Center (OCC) by Modbus TCP over Ethernet. We implemented a 3D graphical PRT operation simulator which can emulate the mixing operation of the virtual vehicles and the actual vehicles.

• Journal of the Korea Society of Computer and Information
• /
• v.15 no.1
• /
• pp.219-226
• /
• 2010

Recently most parking control systems provide customers with various services, but most of the services are just the extension of parking spaces, automatic parking control system and so on. It is essential to use the satisfaction degree as the extent that customer are satisfied with parking control system to improve the quality of the system services and diversify the system services. The degree of satisfaction is different from customer to customer in same condition and can be represented as linguistic variables. In this paper, we present therefore a technique that quantify how much customer are satisfied with parking control system and fuzzy inference system architecture as a solution that can help us to make a efficient decision for these parking problems. In this architecture, inference engine using fuzzy logic compares context data with the rules in the fuzzy rule-based system, gets the sub-results, aggregates them and defuzzifies the aggregated result using MATLAB application programming to obtain crisp value. Fuzzy inference system architecture presented in this paper, can be used as a efficient method to analyze the satisfaction degree which is represented as fuzzy linguistic variables by human emotion. And it can be used to improve the satisfaction degree of not only parking system but also other service systems of various domains.

• The Journal of the Convergence on Culture Technology
• /
• v.7 no.3
• /
• pp.59-69
• /
• 2021

The Moon Jae-in administration insisted on reforming the prosecution for the reform of power institutions, and also tried to control the power of the prosecution through the establishment of a high-ranking public officials criminal investigation office. Then, what is the direction of the legal prosecution reform? Above all, it is a logic to drastically reduce the power of the prosecution. How to shrink it? First, it is necessary to control or check the power of prosecution and investigation that the prosecution has. Second, the key to the reform of the prosecution is perhaps to separate personnel rights from power. In order to exclude external pressure from the prosecution's personnel rights, there must be no instruction or intervention from the attorney general. To do this, the prosecutor general must go through various personnel evaluations, such as multi-faceted evaluation. Third, the essence of the High-ranking Officials Criminal Investigations Act is to deal with crimes of prosecutors, judges, police, and members of the National Assembly. It is also the core of the institutional mechanism to cover the corruption of one's family members while holding all the right to investigate, prosecution, and warrant claims, and to check the omnipresent prosecutors who have abused their right to investigate for political purposes. Then, what is necessary for the success of the high-ranking officials criminal investigation office? Above all, We think political neutrality is very necessary. The Ministry of Airborne has a very high authority of the Director. This paper intends to examine the functions and roles of the prosecution and high-ranking officials criminal investigation offices to prevent corruption. We analyzed the contents of the prosecution and the public officials criminal investigation office, and examined the limitations and problems, and the measures to control corruption in public offices.

• Journal of the Korea Institute of Information Security & Cryptology
• /
• v.28 no.2
• /
• pp.471-484
• /
• 2018

Recently, cyber threats are frequently occurring in ICS(industrial control systems) of government agencies, infrastructure, and manufacturing companies. In order to cope with such cyber threats, it is necessary to apply CTI to ICS. For this purpose, a security information collection system is needed. However, it is difficult to install security solution in control devices such as PLC. Therefor, it is difficult to collect security information of ICS. In addition, there is a problem that the security information format generated in various assets is different. Therefore, in this paper, we propose an efficient method to collect ICS security information. We utilize CybOX/STIX/TAXII CTI models that are easy to apply to ICS. Using this model, we designed the formats to collect security information of ICS assets. We created formats for system logs, IDS logs, and EWS application logs of ICS assets using Windows and Linux. In addition, we designed and implemented a security information collection system that reflects the designed formats. This system can be used to apply monitoring system and CTI to future ICS.

• Journal of Korean Society of Environmental Engineers
• /
• v.38 no.9
• /
• pp.482-496
• /
• 2016

Algal blooms of cyanobacteria (blue-green Algae) due to the eutrophication of rivers and lakes can cause not only the damage by its biological toxins but also the economic loss in drinking water treatment. The natural algae coagulant, a commercial product known as W.H. containing the algicidal and allelopathic material derived from oak, can control algal problems proactively through the coagulation flotation process. However, because there have been no applications of the process for pre-treatment in drinking water plants, we could find no report on the optimum injection dose of W.H.. In this study, we have conducted several sets of jar-tests while changing W.H. dose and concentration of chl-a for (1) Han-river samples and (2) subcultured cyanobacteria samples, and monitored the removal mechanisms of algae intensively. Based on these jar-test results, two linear equations with variables of chl-a and turbidity have been deduced to predict the optimal W.H. dose after the multiple regression analysis using IBM-SPSS. Also, prototypes of automatic control logic have been suggested to inject the optimal W.H. dose promptly in response to the variation of water quality.

• Journal of Korean Society of Steel Construction
• /
• v.24 no.3
• /
• pp.325-336
• /
• 2012

Smart base isolation systems developed for structures in high seismic regions cannot be directly applied to structures in regions of low-to-moderate seismicity, such as Korea. Therefore, the problems that occur by applying the smart base isolation system for high seismic regions to the structures in regions of low-to-moderate seismicity have been investigated in this study. To this end, a five-story building is used as an example, and an MR damper and low damping elastomeric bearings were used to compose a smart base isolation system. Artificial earthquakes are simulated for ground motions in regions of high and low-to-moderate seismicity. Based on numerical simulation results, the MR damper capacity that can provide good control is quite different among regions of high and low-to-moderate seismicity. Moreover, it is noted that the properties of a smart base isolation system for the regions of low-to-moderate seismicity should be carefully designed because the base isolation effects of the smart base isolation system for high seismic regions deteriorate when it is applied to the structures in regions of low-to-moderate seismicity.