Browse > Article
http://dx.doi.org/10.12815/kits.2021.20.6.242

Development of Commercial Game Engine-based Low Cost Driving Simulator for Researches on Autonomous Driving Artificial Intelligent Algorithms  

Im, Ji Ung (Dept. of Department of Electrical and Computer Eng., Graduate School of Inha University)
Kang, Min Su (Dept. of Department of Electrical and Computer Eng., Graduate School of Inha University)
Park, Dong Hyuk (Dept. of Department of Electrical and Computer Eng., Graduate School of Inha University)
Won, Jong hoon (Dept. of Department of Electrical Eng., Inha University)
Publication Information
The Journal of The Korea Institute of Intelligent Transport Systems / v.20, no.6, 2021 , pp. 242-263 More about this Journal
Abstract
This paper presents a method to implement a low-cost driving simulator for developing autonomous driving algorithms. This is implemented by using GTA V, a physical engine-based commercial game software, containing a function to emulate output and data of various sensors for autonomous driving. For this, NF of Script Hook V is incorporated to acquire GT data by accessing internal data of the software engine, and then, various sensor data for autonomous driving are generated. We present an overall function of the developed driving simulator and perform a verification of individual functions. We explain the process of acquiring GT data via direct access to the internal memory of the game engine to build up an autonomous driving algorithm development environment. And, finally, an example applicable to artificial neural network training and performance evaluation by processing the emulated sensor output is included.
Keywords
Autonomous Driving System; Driving Simulator; Sensor Emulation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Hendriks F., Tideman M., Pelders R., Bours R. and Liu X.(2010), "Development tools for active safety systems: Prescan and VeHIL," In Proceedings of 2010 IEEE International Conference on Vehicular Electronics and Safety, pp.54-58.
2 Im J. U.(2020), Development of Commercial Game Engine-based Driving Simulator for Researches on Autonomous Driving Artificial Intelligent Algorithms, Master's Thesis, Inha University Graduate School.
3 IPG Automotive, https://ipg-automotive.com/products-services/simulation-software/, 2021.04.14.
4 Ji G. H. and Won J. H.(2018), "Implementation of integrated navigation algorithm based on GNSS-VTL and INS," Proceeding of Korean GNSS Society Conference, Jeju, South Korea.
5 Kaplan E. D. and Hegarty C. J.(1996), Understanding GPS: Principles and Applications, Boston: Artech House Publishers, pp.29-34.
6 Meinl F., Stolz M., Kunert M. and Blume H.(2017), "An experimental high performance radar system for highly automated driving," In 2017 IEEE MTT-S International Conference on Microwaves for Intelligent Mobility (ICMIM), pp.71-74.
7 Smid A.(2017), Comparison of unity and unreal engine, Czech Technical University in Prague, pp.41-61.
8 VectoreNav, https://www.vectornav.com/products/vn-200, 2021.04.15.
9 Yasuma F., Mitsunaga T., Iso D. and Nayar S. K.(2010), "Generalized assorted pixel camera: Postcapture control of resolution, dynamic range, and spectrum," IEEE Transactions on Image Processing, pp.2241-2253.
10 Zhang X., Xu W., Dong C. and Dolan J. M.(2017), "Efficient L-shape fitting for vehicle detection using laser scanners," In 2017 IEEE Intelligent Vehicles Symposium (IV), pp.54-59.
11 Chen S., Hu J., Shi Y., Peng Y., Fang J., Zhao R. and Zhao L.(2017), "Vehicle-to-everything (V2X) services supported by LTE-based systems and 5G," IEEE Communications Standards Magazine, pp.70-76.
12 Chucholowski F., Gnandt C., Hepperle C. and Hafner S.(2016), "Close to reality surrounding model for virtual testing of autonomous driving and ADAS," In Advanced Vehicle Control, Proceedings of the 13th International Symposium on Advanced Vehicle Control (AVEC'16), pp.85-90.
13 AB Software Development, http://www.dev-c.com/, 2021.04.14.
14 AV Simulation, https://www.avsimulation.com/, 2021.04.14.
15 Blana E.(1996), "Driving Simulator Validation Studies: A Literature Review," Working Paper, Institute of Transport Studies, University of Leeds, UK.
16 Bochkovskiy A., Wang C. Y. and Liao H. Y. M.(2020), Yolov4: Optimal speed and accuracy of object detection, arXiv preprint arXiv:2004.10934.
17 FiveM, https://fivem.net/, 2021.04.14.
18 Forsyth D. A. and Ponce J.(2003), Computer Vision: A Modern Approach, New Jersey: Prentice Hall, pp.11-18.
19 Kang M. S., An S. H., Do Y. H. and Won J. H.(2020), "Implementation of a Server based Multi Client Autonomous Navigation Simulator Hardware System," 2020 IPNT Conference.
20 Kang M. S. and Won J. H.(2021), "Lidar and V2X-based Cooperative Localization Techniques Using EKF and PF," Proceeding of Korean GNSS Society Conference, Jeju, South Korea.
21 Shah S., Dey D., Lovett C. and Kapoor A.(2018), "Airsim: High-fidelity visual and physical simulation for autonomous vehicles," In Field and service robotics, Springer, pp.621-635.
22 Godley S. T., Triggs T. J. and Fildes B. N.(2002), "Driving simulator validation for speed research," Accident Analysis & Prevention, vol. 34, no. 5, pp.589-600.   DOI
23 Martinez M., Sitawarin C., Finch K., Meincke L., Yablonski A. and Kornhauser A.(2017), Beyond grand theft auto V for training, testing and enhancing deep learning in self driving cars, arXiv preprint arXiv:1712.01397.
24 Mechanical Simulation, https://www.carsim.com/products/carsim/index.php, 2021.04.14.
25 Payload, https://en.wikipedia.org/wiki/Payload_(computing), 2021.04.29.
26 Joa E., Yi K. and Kim K.(2015), "A lateral driver model for vehicle-driver closed-loop simulation at the limits of handling," Vehicle System Dynamics, vol. 53, no. 9, pp.1247-1268.   DOI
27 Won J. H.(2005), Studies on the Software-Based GPS Receiver and Navigation Algorithms, Doctoral Dissertation, Ajou University Graduate School.
28 Tass International, https://tass.plm.automation.siemens.com/prescan-overview, 2021.04.14.
29 Vector, https://www.vector.com/int/en/company/about-vector/memberships/from-tesis-to-vector/, 2021.04.14.
30 WithRobot, http://withrobot.com/camera/ocam-5cro-u/, 2021.04.15.
31 Yoon S., Jung J., Hong J., Lim K., Kim J. and Kim H.(2020), "Development of Autonomous Vehicle Learning Data Generation System," The Journal of The Korea Institute of Intelligent Transport Systems, vol. 19, no. 5, pp.162-177.   DOI
32 Yue X., Wu B., Seshia S. A., Keutzer K. and Sangiovanni-Vincentelli A. L.(2018), "A lidar point cloud generator: From a virtual world to autonomous driving," In Proceedings of the 2018 ACM on International Conference on Multimedia Retrieval, pp.458-464.