• Title/Summary/Keyword: Aerial path

Search Result 108, Processing Time 0.026 seconds

A Study of Unmanned Aerial Vehicle Path Planning using Reinforcement Learning

  • Kim, Cheong Ghil
    • Journal of the Semiconductor & Display Technology
    • /
    • v.17 no.1
    • /
    • pp.88-92
    • /
    • 2018
  • Currently drone industry has become one of the fast growing markets and the technology for unmanned aerial vehicles are expected to continue to develop at a rapid rate. Especially small unmanned aerial vehicle systems have been designed and utilized for the various field with their own specific purposes. In these fields the path planning problem to find the shortest path between two oriented points is important. In this paper we introduce a path planning strategy for an autonomous flight of unmanned aerial vehicles through reinforcement learning with self-positioning technique. We perform Q-learning algorithm, a kind of reinforcement learning algorithm. At the same time, multi sensors of acceleraion sensor, gyro sensor, and magnetic are used to estimate the position. For the functional evaluation, the proposed method was simulated with virtual UAV environment and visualized the results. The flight history was based on a PX4 based drones system equipped with a smartphone.

Path Planning of the Low Altitude Flight Unmanned Aerial Vehicle for the Neutralization of the Enemy Firepower (대화력전 임무수행을 위한 저고도 비행 무인공격기의 경로계획)

  • Yang, Kwang-Jin;Kim, Si-Tai;Jung, Dae-Han
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.15 no.4
    • /
    • pp.424-434
    • /
    • 2012
  • This paper presents a path planning algorithm of the unmanned aerial vehicle for the neutralization of the enemy firepower. The long range firepower of the ememy is usually located at the rear side of the mountain which is difficult to bomb. The path planner not only consider the differential constraints of the Unmanned Aerial Vehicle (UAV) but also consider the final approaching angle constraint. This problem is easily solved by incorporating the analytical upper bounded continuous curvature path smoothing algorithm into the Rapidly Exploring Random Tree (RRT) planner. The proposed algorithm can build a feasible path satisfying the kinematic constraints of the UAV on the fly. In addition, the curvatures of the path are continuous over the whole path. Simulation results show that the proposed algorithm can generate a feasible path of the UAV for the bombing mission regardless of the posture of the tunnel.

A Optimization Study of UAV Path Planning Generation based-on Rapid-exploring Random Tree Method (급속탐색랜덤트리기법 기반의 무인 비행체 경로계획생성 최적화 연구)

  • Jae-Hwan Bong;Seong-Kyun Jeong
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.18 no.5
    • /
    • pp.981-988
    • /
    • 2023
  • As the usage of unmanned aerial vehicles expands, the development and the demand of related technologies are increasing. As the frequency of operation increases and the convenience of operation is emphasized, the importance of related autonomous flight technology is also highlighted. Establishing a path plan to reach the destination in autonomous flight of an unmanned aerial vehicle is important in guidance and control, and a technology for automatically generating path plan is required in order to maximize the effect of unmanned aerial vehicle. In this study, the optimization research of path planning using rapid-exploring random tree method was performed for increasing the effectiveness of autonomous operation. The path planning optimization method considering the characteristics of the unmanned aerial vehicle is proposed. In order to achieve indexes such as optimal distance, shortest time, and passage of mission points, the path planning was optimized in consideration of the mission goals and dynamic characteristics of the unmanned aerial vehicle. The proposed methods confirmed their applicability to the generation of path planning for unmanned aerial vehicles through performance verification for obstacle situations.

A Path Planning to Maximize Survivability for Unmanned Aerial Vehicle based on 3-dimensional Environment (3차원 환경 기반 무인 항공기 생존성 극대화를 위한 이동 경로 계획)

  • Kim, Ki-Tae;Jeon, Geon-Wook
    • IE interfaces
    • /
    • v.24 no.4
    • /
    • pp.304-313
    • /
    • 2011
  • An Unmanned Aerial Vehicle(UAV) is a powered pilotless aircraft, which is controlled remotely or autonomously. UAVs are currently employed in many military missions(surveillance, reconnaissance, communication relay, targeting, strike etc.) and a number of civilian applications(communication service, broadcast service, traffic control support, monitoring, measurement etc.). For accomplishing the UAV's missions, guarantee of survivability should be preceded. The main objective of this study is the path planning to maximize survivability for UAV based on 3-dimensional environment. A mathematical programming model is suggested by using MRPP(Most Reliable Path Problem) and solved by transforming MRPP into SPP(Shortest Path Problem). This study also suggests a $A^*PS$ algorithm based on 3-dimensional environment to UAV's path planning. According to comparison result of the suggested algorithm and SPP algorithms (Dijkstra, $A^*$ algorithm), the suggested algorithm gives better solution than SPP algorithms.

A Selection of Path Planning Algorithm to Maximize Survivability for Unmanned Aerial Vehicle (무인 항공기 생존성 극대화를 위한 이동 경로 계획 알고리즘 선정)

  • Kim, Ki-Tae;Jeon, Geon-Wook
    • Journal of the Korea Safety Management & Science
    • /
    • v.13 no.2
    • /
    • pp.103-113
    • /
    • 2011
  • This research is to select a path planning algorithm to maximize survivability for Unmanned Aerial Vehicle(UAV). An UAV is a powered pilotless aircraft, which is controlled remotely or autonomously. UAVs are currently employed in many military missions(surveillance, reconnaissance, communication relay, targeting, strike etc.) and a number of civilian applications(communication service, broadcast service, traffic control support, monitoring, measurement etc.). In this research, a mathematical programming model is suggested by using MRPP(Most Reliable Path Problem) and verified by using ILOG CPLEX. A path planning algorithm for UAV is selected by comparing of SPP(Shortest Path Problem) algorithms which transfer MRPP into SPP.

A Local Path Planning for Unmanned Aerial Vehicle on the Battlefield of Dynamic Threats (동적인 위협이 존재하는 전장에서의 무인 항공기 지역경로계획)

  • Kim, Ki-Tae;Nam, Yong-Keun;Cho, Sung-Jin
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.35 no.1
    • /
    • pp.39-46
    • /
    • 2012
  • An unmanned aerial vehicle (UAV) is a powered aerial vehicle that does not carry a human operator, uses aerodynamic forces to provide vehicle lift, can fly autonomously or be piloted remotely, can be expendable or recoverable, and can carry a lethal or non-lethal payload. An UAV is very important weapon system and is currently being employed in many military missions (surveillance, reconnaissance, communication relay, targeting, strike, etc.) in the war. To accomplish UAV's missions, guarantee of survivability should be preceded. The main objective of this study is a local path planning to maximize survivability for UAV on the battlefield of dynamic threats (obstacles, surface-to-air missiles, radar etc.). A local path planning is capable of producing a new path in response to environmental changes. This study suggests a $Smart$ $A^*$ (Smart A-star) algorithm for local path planning. The local path planned by $Smart$ $A^*$ algorithm is compared with the results of existing algorithms ($A^*$ $Replanner$, $D^*$) and evaluated performance of $Smart$ $A^*$ algorithm. The result of suggested algorithm gives the better solutions when compared with existing algorithms.

Path Planning for Search and Surveillance of Multiple Unmanned Aerial Vehicles (다중 무인 항공기 이용 감시 및 탐색 경로 계획 생성)

  • Sanha Lee;Wonmo Chung;Myunggun Kim;Sang-Pill Lee;Choong-Hee Lee;Shingu Kim;Hungsun Son
    • The Journal of Korea Robotics Society
    • /
    • v.18 no.1
    • /
    • pp.1-9
    • /
    • 2023
  • This paper presents an optimal path planning strategy for aerial searching and surveying of a user-designated area using multiple Unmanned Aerial Vehicles (UAVs). The method is designed to deal with a single unseparated polygonal area, regardless of polygonal convexity. By defining the search area into a set of grids, the algorithm enables UAVs to completely search without leaving unsearched space. The presented strategy consists of two main algorithmic steps: cellular decomposition and path planning stages. The cellular decomposition method divides the area to designate a conflict-free subsearch-space to an individual UAV, while accounting the assigned flight velocity, take-off and landing positions. Then, the path planning strategy forms paths based on every point located in end of each grid row. The first waypoint is chosen as the closest point from the vehicle-starting position, and it recursively updates the nearest endpoint set to generate the shortest path. The path planning policy produces four path candidates by alternating the starting point (left or right edge), and the travel direction (vertical or horizontal). The optimal-selection policy is enforced to maximize the search efficiency, which is time dependent; the policy imposes the total path-length and turning number criteria per candidate. The results demonstrate that the proposed cellular decomposition method improves the search-time efficiency. In addition, the candidate selection enhances the algorithmic efficacy toward further mission time-duration reduction. The method shows robustness against both convex and non-convex shaped search area.

Design and Implementation of an Optimal 3D Flight Path Recommendation System for Unmanned Aerial Vehicles (무인항공기를 위한 최적의 3차원 비행경로 추천 시스템 설계 및 구현)

  • Kim, Hee Ju;Lee, Won Jin;Lee, Jae Dong
    • Journal of Korea Multimedia Society
    • /
    • v.24 no.10
    • /
    • pp.1346-1357
    • /
    • 2021
  • The drone technology, which is receiving a lot of attention due to the 4th industrial revolution, requires an Unmanned Aerial Vehicles'(UAVs) flight path search algorithm for automatic operation and driver assistance. Various studies related to flight path prediction and recommendation algorithms are being actively conducted, and many studies using the A-Star algorithm are typically performed. In this paper, we propose an Optimal 3D Flight Path Recommendation System for unmanned aerial vehicles. The proposed system was implemented and simulated in Unity 3D, and by indicating the meaning of the route using three different colors, such as planned route, the recommended route, and the current route were compared each other. And obstacle response experiments were conducted to cope with bad weather. It is expected that the proposed system will provide an improved user experience compared to the existing system through accurate and real-time adaptive path prediction in a 3D mixed reality environment.

Mission Path Planning to Maximize Survivability for Multiple Unmanned Aerial Vehicles based on 3-dimensional Grid Map (3차원 격자지도 기반 생존성 극대화를 위한 다수 무인 항공기 임무경로 계획)

  • Kim, Ki-Tae;Jeon, Geon-Wook
    • IE interfaces
    • /
    • v.25 no.3
    • /
    • pp.365-375
    • /
    • 2012
  • An Unmanned Aerial Vehicle (UAV) is a powered pilotless aircraft, which is controlled remotely or autonomously. UAVs are an attractive alternative for many scientific and military organizations. UAVs can perform operations that are considered to be risky or uninhabitable for humans. UAVs are currently employed in many military missions and a number of civilian applications. For accomplishing the UAV's missions, guarantee of survivability should be preceded. The main objective of this study is to suggest a mathematical programming model and a $A^*PS$_PGA (A-star with Post Smoothing_Parallel Genetic Algorithm) for Multiple UAVs's path planning to maximize survivability. A mathematical programming model is composed by using MRPP (Most Reliable Path Problem) and MTSP (Multiple Traveling Salesman Problem). After transforming MRPP into Shortest Path Problem (SPP),$A^*PS$_PGA applies a path planning for multiple UAVs.

Path Planning of Unmanned Aerial Vehicle based Reinforcement Learning using Deep Q Network under Simulated Environment (시뮬레이션 환경에서의 DQN을 이용한 강화 학습 기반의 무인항공기 경로 계획)

  • Lee, Keun Hyoung;Kim, Shin Dug
    • Journal of the Semiconductor & Display Technology
    • /
    • v.16 no.3
    • /
    • pp.127-130
    • /
    • 2017
  • In this research, we present a path planning method for an autonomous flight of unmanned aerial vehicles (UAVs) through reinforcement learning under simulated environment. We design the simulator for reinforcement learning of uav. Also we implement interface for compatibility of Deep Q-Network(DQN) and simulator. In this paper, we perform reinforcement learning through the simulator and DQN, and use Q-learning algorithm, which is a kind of reinforcement learning algorithms. Through experimentation, we verify performance of DQN-simulator. Finally, we evaluated the learning results and suggest path planning strategy using reinforcement learning.

  • PDF