• Proceedings of the Korea Water Resources Association Conference
• /
• 2023.05a
• /
• pp.229-229
• /
• 2023

강화학습은 에이전트(agent)가 주어진 환경(environment)과의 상호작용을 통해서 상태(state)를 변화시켜가며 최대의 보상(reward)을 얻을 수 있도록 최적의 행동(action)을 학습하는 기계학습법을 의미한다. 최근 알파고와 같은 게임뿐만 아니라 자율주행 자동차, 로봇 제어 등 다양한 분야에서 널리 사용되고 있다. 상수도관망 분야의 경우에도 펌프 운영, 밸브 운영, 센서 최적 위치 선정 등 여러 문제에 적용되었으나, 설계에 강화학습을 적용한 연구는 없었다. 설계의 경우, 관망의 크기가 커짐에 따라 알고리즘의 탐색 공간의 크기가 증가하여 기존의 최적화 알고리즘을 이용하는 것에는 한계가 존재한다. 따라서 본 연구는 강화학습을 이용하여 상수도관망의 구성요소와 환경요인 간의 복잡한 상호작용을 고려하는 설계 방법론을 제안한다. 모델의 에이전트를 딥 강화학습(Deep Reinforcement Learning)으로 구성하여, 상태 및 행동 공간이 커 발생하는 고차원성 문제를 해결하였다. 또한, 해당 모델의 상태 및 보상으로 절점에서의 압력 및 수요량과 설계비용을 고려하여 적절한 수량과 수압의 용수 공급이 가능한 경제적인 관망을 설계하도록 하였다. 모델의 행동은 실제로 공학자가 설계하듯이 절점마다 하나씩 차례대로 다른 절점과의 연결 여부를 결정하는 것으로, 이를 통해 관망의 레이아웃(layout)과 관경을 결정한다. 본 연구에서 제안한 방법론을 규모가 큰 그리드 네트워크에 적용하여 모델을 검증하였으며, 고려해야 할 변수의 개수가 많음에도 불구하고 목적에 부합하는 관망을 설계할 수 있었다. 모델 학습과정 동안 에피소드의 평균 길이와 보상의 크기 등의 변화를 비교하여, 제안한 모델의 학습 능력을 평가 및 보완하였다. 향후 강화학습 모델을 통해 신뢰성(reliability) 또는 탄력성(resilience)과 같은 시스템의 성능까지 고려한 설계가 가능할 것으로 기대한다.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2022.05a
• /
• pp.73-75
• /
• 2022

Scene Text Recognition is a technology used in the field of artificial intelligence that requires manless robot, automatic vehicles and human-computer interaction. Though scene text images are distorted by noise interference, such as illumination, low resolution and blurring. Unlike previous studies that recognized only English, this paper shows a strong recognition accuracy including various characters, English, Korean, special character and numbers. Instead of selecting only one class having the highest probability value, a candidate word can be generated by considering the probability value of the second rank as well, thus a method can be corrected an existing language misrecognition problem.

• Electronics and Telecommunications Trends
• /
• v.38 no.6
• /
• pp.31-40
• /
• 2023

Given recent accidents involving autonomous vehicles, driver monitoring technology related to the transition of control in autonomous vehicles is gaining prominence. Driver status monitoring systems recognize the driver's level of alertness and identify possible impairments in the driving ability owing to conditions including drowsiness and distraction. In autonomous vehicles, predictive factors for the transition to manual driving should also be included. During traditional human driving, monitoring the driver's status is relatively straightforward owing to the consistency of crucial cues, such as the driver's location, head orientation, gaze direction, and hand placement. However, monitoring becomes more challenging during autonomous driving because of the absence of direct manual control and the driver's engagement in other activities, which may obscure the accurate assessment of the driver's readiness to intervene. Hence, safety-ensuring technology must be balanced with user experience in autonomous driving. We explore relevant global and domestic regulations, the new car assessment program, and related standards to extract requirements for driver status monitoring. This kind of monitoring can both enhance the autonomous driving performance and contribute to the overall safety of autonomous vehicles on the road.

• Journal of Institute of Control, Robotics and Systems
• /
• v.8 no.4
• /
• pp.345-350
• /
• 2002

In recent years, as changing the habit of eating, the pathology in the colon grows up annually. The colonoscopy is generalized, but if requires much time to acquire a dexterous skill to perform an operation and the procedure is painful to the patient. biomedical and robotic researchers are developing a locomotive colonoscope that can travel safe1y in colon. In this paper, we propose a new actuator and concept of semi-autonomous colonoscope. The micro robot comprises camera and LED for diagnosis, steer- ing system to pass through the loop, pneumatic actuator and bow-shaped flexible supporters to control a contact force and to pass over haustral folds in colon. For locomotion of semi-autonomous colonoscope, we suggest an actuator that is based on impact force between a cylinder and a piston. In order to validate the concept and the performance of the actuator, we carried out the simulation of moving characteristics and the preliminary experiments in rigid pipes and on the colon of pig.

• Journal of Institute of Control, Robotics and Systems
• /
• v.21 no.3
• /
• pp.199-209
• /
• 2015

This paper presents a model predictive control (MPC) approach to control the steering angle in an autonomous vehicle. In designing a highly automated driving control algorithm, one of the research issues is to cope with probable risky situations for enhancement of safety. While human drivers maneuver the vehicle, they determine the appropriate steering angle and acceleration based on the predictable trajectories of surrounding vehicles. Likewise, it is required that the automated driving control algorithm should determine the desired steering angle and acceleration with the consideration of not only the current states of surrounding vehicles but also their predictable behaviors. Then, in order to guarantee safety to the possible change of traffic situation surrounding the subject vehicle during a finite time-horizon, we define a safe driving envelope with the consideration of probable risky behaviors among the predicted probable behaviors of surrounding vehicles over a finite prediction horizon. For the control of the vehicle while satisfying the safe driving envelope and system constraints over a finite prediction horizon, a MPC approach is used in this research. At each time step, MPC based controller computes the desired steering angle to keep the subject vehicle in the safe driving envelope over a finite prediction horizon. Simulation and experimental tests show the effectiveness of the proposed algorithm.

• The KIPS Transactions:PartB
• /
• v.14B no.3 s.113
• /
• pp.163-170
• /
• 2007

In autonomous navigation of a mobile vehicle or a mobile robot, localization calculated from recognizing its environment is most important factor. Generally, we can determine position and pose of a camera equipped mobile vehicle or mobile robot using INS and GPS but, in this case, we must use enough known ground landmark for accurate localization. hi contrast with homography method to calculate position and pose of a camera by only using the relation of two dimensional feature point between two frames, in this paper, we propose a method to calculate the position and the pose of a camera using relation between the location to predict through perspective transform of 3D feature points obtained by overlaying 3D model with previous frame using GPS and INS input and the location of corresponding feature point calculated using KLT tracking method in current frame. For the purpose of the performance evaluation, we use wireless-controlled vehicle mounted CCD camera, GPS and INS, and performed the test to calculate the location and the rotation angle of the camera with the video sequence stream obtained at 15Hz frame rate.

• The Journal of Korea Robotics Society
• /
• v.17 no.2
• /
• pp.142-151
• /
• 2022

With the advent of the 4th industrial revolution, autonomous driving technology is being commercialized in various industries. However, research on autonomous driving so far has focused on platforms with wheel-type platform. Research on a tracked platform is at a relatively inadequate step. Since the tracked platform has a different driving and steering method from the wheel-type platform, the existing research cannot be applied as it is. Therefore, a path-tracking algorithm suitable for a tracked platform is required. In this paper, we studied a path-tracking algorithm for a tracked platform based on a GPS sensor. The existing Pure Pursuit algorithm was applied in consideration of the characteristics of the tracked platform. And to compensate for "Cutting Corner", which is a disadvantage of the existing Pure Pursuit algorithm, an algorithm that changes the LAD according to the curvature of the path was developed. In the existing pure pursuit algorithm that used a tracked platform to drive a path including a right-angle turn, the RMS path error in the straight section was 0.1034 m and the RMS error in the turning section was measured to be 0.2787 m. On the other hand, in the variable LAD algorithm, the RMS path error in the straight section was 0.0987 m, and the RMS path error in the turning section was measured to be 0.1396 m. In the turning section, the RMS path error was reduced by 48.8971%. The validity of the algorithm was verified by measuring the path error by tracking the path using a tracked robot platform.

• Journal of IKEEE
• /
• v.9 no.1 s.16
• /
• pp.7-18
• /
• 2005

A key component of an autonomous mobile robot is to localize itself accurately and build a map of the environment simultaneously. In this paper, we propose a vision-based mobile robot localization and mapping algorithm using scale-invariant features. A camera with fisheye lens facing toward to ceiling is attached to the robot to acquire high-level features with scale invariance. These features are used in map building and localization process. As pre-processing, input images from fisheye lens are calibrated to remove radial distortion then labeling and convex hull techniques are used to segment ceiling region from wall region. At initial map building process, features are calculated for segmented regions and stored in map database. Features are continuously calculated from sequential input images and matched against existing map until map building process is finished. If features are not matched, they are added to the existing map. Localization is done simultaneously with feature matching at map building process. Localization. is performed when features are matched with existing map and map building database is updated at same time. The proposed method can perform a map building in 2 minutes on $50m^2$ area. The positioning accuracy is ${\pm}13cm$, the average error on robot angle with the positioning is ${\pm}3$ degree.

• Journal of Convergence for Information Technology
• /
• v.11 no.4
• /
• pp.83-101
• /
• 2021

This study is to investigate, using AHP, what technologies should be applied first to Korean SMEs in order to respond to the 4th industrial revolution and change to a smart enterprise. To this end, technologies related to the 4th industrial revolution and smart factory are synthesized, and the classification criteria of Dae-Hoon Kim et al. (2019) are applied, but additional opinions of experts are collected and related technologies are converted to artificial intelligence (AI), Big Data, and Cloud Computing. As a base technology, mobile, Internet of Things (IoT), block chain as hyper-connected technology, unmanned transportation (autonomous driving), robot, 3D printing, drone as a convergence technology, smart manufacturing and logistics, smart healthcare, smart transportation and smart finance were classified as smart industrial technologies. As a result of confirming the priorities for technical use by AHP analysis and calculating the total weight, manufacturing companies have a high ranking in mobile, artificial intelligence (AI), big data, and robots, while service companies are in big data and robots, artificial intelligence (AI), and smart healthcare are ranked high, and in all companies, it is in the order of big data, artificial intelligence (AI), robot, and mobile. Through this study, it was clearly identified which technologies should be applied first in order to respond to the 4th industrial revolution and change to a smart company.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.17 no.1
• /
• pp.33-39
• /
• 2017

In mission-critical applications such as vehicular networks, distributed robotics, and other cyber-physical systems, the requirements for latency are more stringent than traditional applications. Among them, autonomous V2V communication is a rapidly emerging domain of applications with a few milliseconds' latency requirements. Today's systems utilizing 802.11p or LTE-direct standards are not primarily designed for ultra-low latency. Because the medium access function contributes to a significant portion of the total latency, it is necessary to modify Layer2 in order to solve the problem. Focusing on MAC layer, we developed a scalable and latency-guaranteed MAC by devising Autonomous TDMA (ATDMA) in which autonomous joining/leaving is allowed without scheduling by coordinator. We also evaluated the performance of the algorithm by comparing with the WAVE protocol.