Browse > Article
http://dx.doi.org/10.9717/kmms.2020.23.8.1075

Customized Pilot Training Platform with Collaborative Deep Learning in VR/AR Environment  

Kim, Hee Ju (Department of Computer Engineering, Dankook University)
Lee, Won Jin (Research Institute of Information and Culture Technology, Dankook University)
Lee, Jae Dong (Department of Software Engineering, Dankook University)
Publication Information
Journal of Korea Multimedia Society / v.23, no.8, 2020 , pp. 1075-1087 More about this Journal
Abstract
Aviation ICT technology is a convergence technology between aviation and electronics, and has a wide variety of applications, including navigation and education. Among them, in the field of aerial pilot training, there are many problems such as the possibility of accidents during training and the lack of coping skills for various situations. This raises the need for a simulated pilot training system similar to actual training. In this paper, pilot training data were collected in pilot training system using VR/AR to increase immersion in flight training, and Customized Pilot Training Platform with Collaborative Deep Learning in VR/AR Environment that can recommend effective training courses to pilots is proposed. To verify the accuracy of the recommendation, the performance of the proposed collaborative deep learning algorithm with the existing recommendation algorithm was evaluated, and the flight test score was measured based on the pilot's training data base, and the deviations of each result were compared. The proposed service platform can expect more reliable recommendation results than previous studies, and the user survey for verification showed high satisfaction.
Keywords
Customized Platform; Pilot Training; Deep Learning; Recommendation;
Citations & Related Records
Times Cited By KSCI : 10  (Citation Analysis)
연도 인용수 순위
1 H.H. Lee and W.J. Lee, “Desgin and Implementation of Agent-recruitment Service System Based on Collaborative Deep Learning for the Intelligent Head Hunting Service,” Journal of Korea Multimedia Society, Vol. 23, No. 2, pp. 343-350, 2020.
2 H. Wang, N. Wang, and D.Y. Yeung, "Collaborative Deep Learning for Recommender Systems," Proceeding of the 21th ACM Special Interest Group on Knowledge Discovery in Data International Conference on Knowledge Discovery and Data Mining, 2015. (pp. 1235-1244)
3 H. Ying, L. Chen, Y. Xiong, and J. Wu, "Colla-Borative Deep Ranking: A Hybrid Pair-wise Recommendation Algorithm with Implicit Feedback," Pacificasia Conference on Knowledge Discovery and Data Mining, pp. 555-567, 2016.
4 X. Kong, B. Xin, Y. Wang, and G. Hua, "Colla-Borative Deep Reinforcement Learning for Joint Object Search," Proceeding of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1695-1704, 2017.
5 H.H. Lee and W.J. Lee, “Image Label Prediction Algorithm Based on Convolution Neural Network with Collaborative Layer,” Journal of Korea Multimedia Society, Vol. 23, No. 6, pp. 756-764, 2020.
6 I. Stephen, “Perceptron-based Learning Algorithms,” IEEE Transactions on Neural Networks, Vol. 50, No. 2, pp. 179-191, 1990.
7 T. Mikolov, S. Kombrink, L. Burget, J. Cernocky, and S. Khudanpur, "Extensions of Recurrent Neural Network Language Model," Proceedings of 2011 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 5528-5531, 2011.
8 K. Lee and H. Lee, "A Study on the Airline Pilot Recruitment for a Effective Utilization," Journal of Aerospace Industry, Vol. 74, pp. 1-19, 2011.
9 J. Choi, “Domestic Aviation Manpower Training Program Policy Status and Performance,” Journal of Aviation Development of Korea, Vol. 1, No. 60, pp. 41-51, 2013.
10 What is UPRT?(2018), https://www.easa.europa.eu/faq/44870 (accessed July 08, 2020).
11 R.T. Hays, J.W. Jacobs, C. Prince, and E. Salas, “Flight Simulator Training Effectiveness: A Meta-analysis,” Military Psychology, Vol. 4, No. 2, pp. 63-74, 2009.   DOI
12 V. Socha, L. Socha, S. Szabo, K. Hana, J. Gazda, M. Kimlickova, et al., "Training of Pilots Using Flight Simulator and its Impact on Piloting Precision," Proceeding of International Conference Transport Means, 2016. (pp. 374-379)
13 J. Chae, “Study on Firefighting Education and Training Applying Virtual Reality,” Fire Science and Engineering, Vol. 32, No. 2, pp. 108-115, 2018.   DOI
14 S. Park, J. Kim, K. Kim, and H. Kim, “AR Based Field Training System Algorithm for Small Units,” Convergence Security Journal, Vol. 18, No. 4, pp. 81-87, 2018.
15 G. Jeong, Y. Lee, C. Lee, M. Kim, and J. Lee, “Assessment of Pilot Training Effectiveness of VR HMD Based Flight Training Device,” Journal of the Korean Society for Aviation and Aeronautics, Vol. 26, No. 4, pp. 129-141, 2018.   DOI
16 R. Francesco, L. Rokach, and B. Shapira, Recommender Systems Handbook, Springer, Boston, 2011.