Browse > Article
http://dx.doi.org/10.7746/jkros.2019.14.2.122

Autonomous-Driving Vehicle Learning Environments using Unity Real-time Engine and End-to-End CNN Approach  

Hossain, Sabir (Center for Artificial Intelligence and Autonomous system, Mechanical Engineering, Kunsan National University)
Lee, Deok-Jin (Center for Artificial Intelligence and Autonomous system, Mechanical Engineering, Kunsan National University)
Publication Information
The Journal of Korea Robotics Society / v.14, no.2, 2019 , pp. 122-130 More about this Journal
Abstract
Collecting a rich but meaningful training data plays a key role in machine learning and deep learning researches for a self-driving vehicle. This paper introduces a detailed overview of existing open-source simulators which could be used for training self-driving vehicles. After reviewing the simulators, we propose a new effective approach to make a synthetic autonomous vehicle simulation platform suitable for learning and training artificial intelligence algorithms. Specially, we develop a synthetic simulator with various realistic situations and weather conditions which make the autonomous shuttle to learn more realistic situations and handle some unexpected events. The virtual environment is the mimics of the activity of a genuine shuttle vehicle on a physical world. Instead of doing the whole experiment of training in the real physical world, scenarios in 3D virtual worlds are made to calculate the parameters and training the model. From the simulator, the user can obtain data for the various situation and utilize it for the training purpose. Flexible options are available to choose sensors, monitor the output and implement any autonomous driving algorithm. Finally, we verify the effectiveness of the developed simulator by implementing an end-to-end CNN algorithm for training a self-driving shuttle.
Keywords
Autonomous Shuttle Vehicle; Artificial Intelligence; Virtual Environment; Behavior Learning;
Citations & Related Records
연도 인용수 순위
  • Reference
1 P. Koopman and M. Wagner, "Challenges in autonomous vehicle testing and validation," SAE International Journal of Transportation Safety, vol. 4, no. 1, pp. 15-24, 2016, doi: 10.4271/2016-01-0128.   DOI
2 E. Blana, "A survey of driving research simulators Around the World," Institute of Transport Studies, University of Leeds, Dec. 1996.
3 X. Pan, Y. You, Z. Wang, and C. Lu, "Virtual to real reinforcement learning for autonomous driving," British Machine Version Conference (BMVC), pp. 11.1-11.13, Sept., 2017, doi: 10.5244/C.31.11.   DOI
4 S. Hossain, A. R. Fayjie, O. Doukhi, and D.-J. Lee, "CAIAS simulator: self-driving vehicle simulator for AI research," International Conference on Intelligent Computing & Optimization, pp. 187-195, 2018, doi: 10.1007/978-3-030-00979-3_19.   DOI
5 M. Bojarski, D. Del Testa, D. Dworakowski, B. Firner, B. Flepp, P. Goyal, L. D. Jackel, M. Monfort, U. Muller, J. Zhang, Xin Zhang, Jake Zhao, and Karol Zieba, "End to end learning for self-driving cars," arXiv:1604.07316 [cs.CV], 2016.
6 Gazebo, [Online], http://gazebosim.org, Accessed: May 26, 2019.
7 ROS.org, [Online], http://wiki.ros.org/gazebo, Accessed: May 26, 2019.
8 L. Meeden, G. McGraw, and D. Blank, "Emergent control and planning in an autonomous vehicle," 15th Annual Conference of the Cognitive Science Society, 1993.
9 B. Wymann, C. Dimitrakakis, A. Sumner, E. Espie, and C. Guionneau, "Torcs, the open racing car simulator," TORCS: The open racing car simulator, Software available at http://torcs.sourceforge.net, Mar., 2015.
10 T. Linner, A. Shrikathiresan, M. Vetrenko, B. Ellmann, and T. Bock, "Modeling and operating robotic environent using Gazebo/ROS," 28th international symposium on automation and robotics in construction (ISARC2011), pp. 957-962, Seoul, Korea, 2011, doi: 10.22260/ISARC2011/0177
11 A. Dosovitskiy, G. Ros, F. Codevilla, A. Lopez, and V. Koltun, "CARLA: An open urban driving simulator," arXiv:1711.03938 [cs.LG], 2017.
12 S. Shah, D. Dey, C. Lovett, and A. Kapoor, "Airsim: High-fidelity visual and physical simulation for autonomous vehicles," Field and service robotics, pp. 621-635, 2018, doi: 10.1007/978-3-319-67361-5_40.
13 Udacity, A self-driving car simulator built with Unity, [Online], https://github.com/udacity/self-driving-car-sim, Accessed: Dec. 14, 2018.
14 V. De Luca, A. Meo, A. Mongelli, P. Vecchio, and L. T. De Paolis, "Development of a virtual simulator for microanastomosis: new opportunities and challenges," International Conference on Augmented Reality, Virtual Reality and Computer Graphics, pp. 65-81, 2016, doi: 10.1007/978-3-319-40651-0_6.   DOI
15 L. Ni, Q. Peng, L. Yu, and J. Wang, "The research and application of products virtual exhibition technology base on unity 3D," Digital Technology and Application, vol. 9, p. 36, 2010.
16 Y. Wang, Self-driving car simulation, [Online], http://wangyangevan.weebly.com/lidar-simulation.html, Accessed: Feb. 16, 2018.
17 F. Codevilla, M. Miiller, A. Lopez, V. Koltun, and A. Dosovitskiy, "End-to-end driving via conditional imitation learning," in 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia, 2018, doi: 10.1109/icra.2018.8460487.
18 N. R. Pal and S. K. Pal, "A review on image segmentation techniques," Pattern recognition, vol. 26, no. 9, pp. 1277-1294, 1993, doi: 10.1016/0031-3203(93)90135-J.   DOI
19 S. v. d. Walt, S. C. Colbert, and G. Varoquaux, "The NumPy array: a structure for efficient numerical computation," Computing in Science & Engineering, vol. 13, no. 2, pp. 22-30, Mar.-Apr., 2011, doi: 10.1109/mcse.2011.37.   DOI
20 A. Lorsakul and J. Suthakorn, "Traffic sign recognition using neural network on OpenCV: Toward intelligent vehicle/driver assistance system," Department of Biomedical Engineering, Faculty of Engineering, Mahidol University, Thailand, 2008.
21 M. Hanggi, S. Moser, E. Pfaffhauser, and G. S. Moschytz, "Simulation and visualization of CNN dynamics," International Journal of Bifurcation and Chaos, vol. 9, no. 7, pp. 1237-1261, 1999, doi: 10.1142/s0218127499000882.   DOI