Browse > Article
http://dx.doi.org/10.20910/JASE.2021.15.1.19

Development of SILS platform for application system based on AR and UAV  

Cho, Wan Joo (Engineering Research Institute, Gyeongsang National university)
Kang, Moon Hye (Gyeongnam National university of Science and Technology)
Moon, Yong Ho (School of Aerospace and Software Eng., Gyeongsang National university)
Publication Information
Journal of Aerospace System Engineering / v.15, no.1, 2021 , pp. 19-31 More about this Journal
Abstract
Recently, the development of UAV application system using augmented reality (AR) has received much attention. In general, the design and implementation of UAV application system are verified with SILS techniques before actual flight experiments. However, existing SILS environment cannot be used to verify the application system based on AR and UAV because it does not include key features related to AR. To overcome this problem, we proposed an SILS platform that could be effectively used for the development of application systems based on AR and UAV. Simulation results on accuracy, efficiency, and scalability show that the proposed platform could be effectively utilized for the development of AR and UAV based-application systems.
Keywords
UAV; SILS; Augmented Reality; HMD; Software Platform;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Changhwan Joe, Seongjoon Park, Inseop Um, Hwangnam Kim, "Exploring Trends and Technologies in Drone Development," Communications of the Korean Institute of Information Scientists and Engineers, vol 37, no. 1, pp. 10-19, January 2019.
2 G. Mehrooz, E. Ebeid and P. Schneider-Kamp, "System Design of an Open-Source Cloud-Based Framework for Internet of Drones Application," 22nd Euromicro Conference on Digital System Design, pp. 572-579, 2019.
3 A. R. Fayjie, A. Ramezani, D. Oualid and D. J. Lee, "Voice enabled smart drone control," Ninth International Conference on Ubiquitous and Future Networks, pp. 119-121, 2017.
4 Q. Bu, F. Wan, Z. Xie, Q. Ren, J. Zhang and S. Liu, "General simulation platform for vision based UAV testing," IEEE International Conference on Information and Automation, pp. 2512-2516, 2015.
5 Doyoon Kim, Sung Tae Moon, Lee Dongoo, "Simulation System Development for Swarm Flight Reconnaissance System" The Korean Institute of Information Scientists and Engineers, pp. 661-663, June 2019.
6 Erat, O., Isop, W. A., Kalkofen, D., and Schmalstieg, D., "Drone-Augmented human vision: Exocentric control for drones exploring hidden areas." IEEE Transactions on Visualization and Computer Graphics, vol. 24, no. 4, pp. 1437-1446, April 2018.   DOI
7 Vaquero-Melchor, D., Garcia-Hospital, J., Bernardos, A. M., Besada, J. A., and Casar, J. R., "Holo-mis: A mixed reality based drone mission definition system." 20th International Conference on Human-Computer Interaction with Mobile Devices and Services, Conference Proceedings Adjunct, pp. 365-370, 2018.
8 Teixeira, J. M., Ferreira, R., Santos, M., and Teichrieb, V., "Teleoperation using google glass and ar, drone for structural inspection." 16th Symposium on Virtual and Augmented Reality, pp. 28-36, 2014.
9 Widiyanti, D. E., and Shin, S. Y. "UAV-assisted Military Mapping System using HoloLens UAV-assisted Military Mapping System using HoloLens." KICS Winter Conference, pp. 1260-1261, February 2020.
10 Raul Llasag, Diego Marcillo, Carlos Grilo, Catarina Silva, "Human Detection for Search and Rescue Applications with UAVs and Mixed Reality Interfaces.", 14th Iberian Conference on Information Systems and Technologies, pp. 1-6, 2019.
11 Mori, A., and Itoh, Y. "Dronecamo: Modifying human-drone comfort via augmented reality.", Adjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, pp. 167-168, 2019.
12 Pradhan, P., "Development of Holographic User Interface for UAV Ground Control using Microsoft HoloLens." ryerson university faculty of engineering, architecture and science, April 2017.
13 Jeong, M., Lee, H., Bae, M., Shin, D. B., Lim, S. H., & Lee, K. B., "Development and Application of the Smart Helmet for Disaster and Safety.", 9th International Conference on Information and Communication Technology Convergence, pp. 1084-1089, 2018.
14 Cai, Z., Chen, M., and Yang, L., "Multi-source information fusion augmented reality benefited decision-making for unmanned aerial vehicles: A effective way for accurate operation.", Proceedings of the 6th IEEE Conference on Industrial Electronics and Applications, pp. 174-178, 2011.
15 Sreeram, S., Nisha, K. K., and Jayakrishnan, R., "Virtual Design Review and Planning Using Augmented Reality and Drones.", Proceedings of the 2nd International Conference on Intelligent Computing and Control Systems, pp. 915-918, 2018.
16 Unal, M., Bostanci, E., Sertalp, E., Guzel, M. S., and Kanwal, N. "Geo-location Based Augmented Reality Application for Cultural Heritage Using Drones.", 2nd International Symposium on Multidisciplinary Studies and Innovative Technologies, 2018.
17 S. Thon, D. Serena-Allier, C. Salvetat, F. Lacotte, "Flying a drone in a museum: An augmented-reality cultural serious game in Provence.", Digital Heritage International Congress, vol. 2, pp. 669-676, November 2013.
18 J. Zhao, R. S. Allison, M. Vinnikov and S. Jennings, "The Effects of Visual and Control Latency on Piloting a Quadcopter Using a Head-Mounted Display," 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Miyazaki, Japan, pp. 2972-2979, 2018.
19 Mixed Reality Tool Kit manual, https://microsoft.github.io/MixedRealityToolkit-Unity/Documentation/WelcomeToMRTK.html.
20 UWP framework manual, https://docs.microsoft.com/ko-kr/windows/uwp/get-started/universal-application-platform-guide.
21 JMavsim (2020 August 20), https://github.com/PX4/jMAVSim.
22 Shital Shah and Debadeepta Dey and Chris Lovett and Ashish Kapoor, "AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles", Field and Service Robotics, pp. 621-63, November 2017.
23 MAVSDK manual, https://mavsdk.mavlink.io/develop/en/index.html.