Browse > Article

A Study of Unmanned Aerial Vehicle Path Planning using Reinforcement Learning  

Kim, Cheong Ghil (Department Of Computer Science, Namseoul University)
Publication Information
Journal of the Semiconductor & Display Technology / v.17, no.1, 2018 , pp. 88-92 More about this Journal
Abstract
Currently drone industry has become one of the fast growing markets and the technology for unmanned aerial vehicles are expected to continue to develop at a rapid rate. Especially small unmanned aerial vehicle systems have been designed and utilized for the various field with their own specific purposes. In these fields the path planning problem to find the shortest path between two oriented points is important. In this paper we introduce a path planning strategy for an autonomous flight of unmanned aerial vehicles through reinforcement learning with self-positioning technique. We perform Q-learning algorithm, a kind of reinforcement learning algorithm. At the same time, multi sensors of acceleraion sensor, gyro sensor, and magnetic are used to estimate the position. For the functional evaluation, the proposed method was simulated with virtual UAV environment and visualized the results. The flight history was based on a PX4 based drones system equipped with a smartphone.
Keywords
Unmanned Aerial Vehicles; Path Planning; Multi-sensor; Self-positioning; Reinforce Learning;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Weis, A., Smart drones, Project Report, Tallinn University of Technology. March 26, 2017, from http://193.40.244.77/idu0310/wp-content/uploads/2015/09/140605_IoT-project_Weis.pdf
2 Jinbae Kim, J., Shin, S., Wu, J., Kim, S.D., Kim, C.G., "Obstacle Avoidance Path Planning For UAV Using Reinforcement Learning Under Simulated Environment," Science and Engineering Letters, 3, pp. 34-36, (2017).
3 Roberge, V., Tarbouchi, M., Labonte, G., "Comparison of parallel genetic algorithm and particle swarm optimization for real-time UAV path planning", IEEE Transactions on Industrial Informatics, 9(1), pp. 132-141, (2017).   DOI
4 Chen, H., Chang, K., & Agate, C. S., "UAV path planning with tangent-plus-Lyapunov vector field guidance and obstacle avoidance", IEEE Transactions on Aerospace and Electronic Systems, 49(2), pp. 840-856, (2013).   DOI
5 Bortoff, S. A., "Path planning for UAVs," Proc. of the 2000 American Control Conference, pp. 364-368, (2000).
6 Zabarankin, M., Uryasev, S., and Pardalos, P., "Optimal risk path algorithm," Technical Report 2001-4, Department of Industrial and Systems Engineering, University of Florida, (2001).
7 McLain, T.W., Beard, R. W., "Trajectory planning for coordinated rendezvous of unmanned air vehicles," Proc. of AIAA Guidance, Navigation and Control Conference, pp. 1-8, (2000).
8 Borenstein, J., Miller, K., "Robots and the Internet: Causes for Concern," IEEE Technology and Society Magazine, 32 (1), pp. 60-65, (2013).   DOI
9 Jun, M., D'Andrea, R., "Path Planning for Unmanned Aerial Vehicles in Uncertain and Adversarial Environments", Cooperative Control: Models, Applications and Algorithms, Springer, 1, pp. 95-110, (2003).
10 Angelino, C. V., Baraniello, V. R., Cicala, L., "UAV position and attitude estimation using IMU, GNSS and camera," Proc. of 15th International Conference on Information Fusion, pp. 735-742, (2012).
11 Xu, L., Luo, H., "Towards autonomous tracking and landing on moving target," Proc. of IEEE International Conference on Real-time Computing and Robotics (RCAR), pp. 620-628, (2016).
12 Lee, K.H., Kim, S.D., "Path Planning of Unmanned Aerial Vehicle based Reinforcement Learning using Deep Q Network under Simulated Environment", Journal of the Semiconductor & Display Technology, 16(3): pp. 127-130, (2017).
13 Shin, S, Nan, Y., Kim, C.G., Kim, S.D., "Multi-sensor Based UAV Positioning Technique", Science and Engineering Letters, 3, pp. 30-33, (2017).