• Smart Media Journal
• /
• v.11 no.9
• /
• pp.9-20
• /
• 2022

Deep reinforcement learning(RL) is an end-to-end data-driven control method that is widely used in the autonomous driving domain. However, conventional RL approaches have difficulties in applying it to autonomous driving tasks due to problems such as inefficiency, instability, and uncertainty. These issues play an important role in the autonomous driving domain. Although recent studies have attempted to solve these problems, they are computationally expensive and rely on special assumptions. In this paper, we propose a new algorithm MCDT that considers inefficiency, instability, and uncertainty by introducing a method called uncertainty sequence modeling to autonomous driving domain. The sequence modeling method, which views reinforcement learning as a decision making generation problem to obtain high rewards, avoids the disadvantages of exiting studies and guarantees efficiency, stability and also considers safety by integrating uncertainty estimation techniques. The proposed method was tested in the OpenAI Gym CarRacing environment, and the experimental results show that the MCDT algorithm provides efficient, stable and safe performance compared to the existing reinforcement learning method.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 2012.05a
• /
• pp.943-944
• /
• 2012

• IEMEK Journal of Embedded Systems and Applications
• /
• v.16 no.6
• /
• pp.285-292
• /
• 2021

Autonomous vehicles are divided into an upper controller that calculates control value through cognitive judgment and a lower controller that appropriately transmits its control value to an actuator. Here, the longitudinal control in a lower controller has a problem as the road slopes due to the property of the Acceleration sensor to output the acceleration as the slope of the device. Therefore, in this paper, a sigmoid function is proposed to determine the slope to compensate for this problem. Through the experiment, Checked performance by comparing the existing table model with the proposed model.

• Journal of Institute of Control, Robotics and Systems
• /
• v.17 no.7
• /
• pp.674-684
• /
• 2011

More and more elderly and disabled people are using electric scooters instead of electric wheelchairs because of higher mobility. However, people with high levels of impairment or the elderly still have difficulties in driving the electric scooters safely. Semi-autonomous electric scooter system is one of the solutions for the safety: Either manual driving or autonomous driving can be used selectively. In this paper, we implement a semi-autonomous electric scooter system with functions of localization and path following. In order to recognize the pose of electric scooter in outdoor environments, we design an outdoor localization system based on the extended Kalman filter using DGPS (Differential Global Positioning System) and wheel encoders. We added an accelerometer to make the localization system adaptable to road condition. Also we propose a path following algorithm using two arcs with current pose of the electric scooter and a given path in the map. Simulation results are described to show that the proposed algorithms provide the ability to drive an electric scooter semi-autonomously. Finally, we conduct outdoor experiments to reveal the practicality of the proposed system.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.16 no.3
• /
• pp.565-570
• /
• 2021

Agriculture in South Korea is losing productivity due to the lack of manpower as aging population increases. To overcome this, the agricultural robot market is growing rapidly, and research is being conducted on remote control and autonomous driving of agricultural robots. This work designs the appearance and structure of agricultural robots and implements the devices and control systems for driving. By utilizing and optimizing LiDAR sensors, we applied object recognition technology, which is an essential function for autonomous driving. This can reduce labor costs and improve productivity of transportation tasks that require the most labor in agriculture.

• Journal of Institute of Control, Robotics and Systems
• /
• v.18 no.8
• /
• pp.787-793
• /
• 2012

This paper introduces the autonomous vehicle Pharos, which participated in the 2010 Autonomous Vehicle Competition organized by Hyundai-Kia motors. PHAROS was developed for high-speed on/off-road unmanned driving avoiding diverse patterns of obstacles. For the high speed traveling up to 60 km/h, long range terrain perception, real-time path planning and high speed vehicle motion control algorithms are developed. This paper describes the major hardware and software components of our vehicle.

• Journal of Auto-vehicle Safety Association
• /
• v.11 no.2
• /
• pp.11-16
• /
• 2019

This paper suggests an algorithm for detecting fault of longitudinal controller in autonomous vehicles. Guaranteeing safety in fault situation is essential because electronic devices in vehicle are dependent each other. Several methods like alarm to driver, ceding control to driver, and emergency stop are considered to cope with fault. This research investigates the fault monitoring process in fail-safe system, for controller which is responsible for accelerating and decelerating control in vehicle. Residual is computed using desired acceleration control command and actual acceleration, and detection of its abnormal increase leads to the decision that system has fault. Before computing residual for controller, health monitoring process of acceleration signal is performed using hardware and analytic redundancy. In fault monitoring process for controller, a process model which is fitted using driving data is considered to improve the performance. This algorithm is simulated via MATLAB tool to verify performance.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2019.01a
• /
• pp.261-262
• /
• 2019

본 논문에서는 신경망 모델에 키보드를 통한 주행 학습을 이용하여 자율 주행을 할 수 있는 시스템을 개발하였다. 주어진 트랙에서 키보드의 방향키를 통해 전진, 후진 등 5가지의 상태로 RC카를 수동 제어하고, 제어시 카메라를 통해 얻어진 이미지를 저장해, 키 제어 데이터와 이미지 데이터를 학습시켜서 자율 주행을 할 수 있는 시스템을 구현하였다.

• Journal of Korea Society of Industrial Information Systems
• /
• v.14 no.4
• /
• pp.91-100
• /
• 2009

In this paper, we propose autonomous intelligent wheelchair system which recognize the commands using the gaze recognition and avoid the detected obstacles by sensing the distance through range sensors on the way to driving. The user's commands are recognized by the gaze recognizer which use a centroid of eye pupil and two reflection points extracted using a camera with infrared filter and two infrared LEDs. These are used to control the wheelchair through the user interface. Then wheelchair system detects the obstacles using 10 ultrasonic sensors and assists that it avoid collision with obstacles. The proposed intelligent wheelchair system consists of gaze recognizor, autonomous driving module, sensor control board and motor control board. The gaze recognizer cognize user's commands through user interface, then the wheelchair is controled by the motor control board using recognized commands. Thereafter obstacle information detected by ultrasonic sensors is transferred to the sensor control board, and this transferred to the autonomous driving module. In the autonomous driving module, the obstacles are detected. For generating commands to avoid these obstacles, there are transferred to the motor control board. The experimental results confirmed that the proposed system can improve the efficiency of obstacle avoidance and provide the convenient user interface to user.

• The Journal of Korea Robotics Society
• /
• v.12 no.3
• /
• pp.297-305
• /
• 2017

As the development of autonomous vehicles becomes realistic, many automobile manufacturers and components producers aim to develop 'completely autonomous driving'. ADAS (Advanced Driver Assistance Systems) which has been applied in automobile recently, supports the driver in controlling lane maintenance, speed and direction in a single lane based on limited road environment. Although technologies of obstacles avoidance on the obstacle environment have been developed, they concentrates on simple obstacle avoidances, not considering the control of the actual vehicle in the real situation which makes drivers feel unsafe from the sudden change of the wheel and the speed of the vehicle. In order to develop the 'completely autonomous driving' automobile which perceives the surrounding environment by itself and operates, ability of the vehicle should be enhanced in a way human driver does. In this sense, this paper intends to establish a strategy with which autonomous vehicles behave human-friendly based on vehicle dynamics through the reinforcement learning that is based on Q-learning, a type of machine learning. The obstacle avoidance reinforcement learning proceeded in 5 simulations. The reward rule has been set in the experiment so that the car can learn by itself with recurring events, allowing the experiment to have the similar environment to the one when humans drive. Driving Simulator has been used to verify results of the reinforcement learning. The ultimate goal of this study is to enable autonomous vehicles avoid obstacles in a human-friendly way when obstacles appear in their sight, using controlling methods that have previously been learned in various conditions through the reinforcement learning.