로봇학회논문지 (The Journal of Korea Robotics Society)

  • 제14권2호
  • /
  • Pages.122-130
  • /
  • 2019
  • /
  • 1975-6291(pISSN)
  • /
  • 2287-3961(eISSN)
한국로봇학회 (Korea Robotics Society)
권호 표지
DOI QR코드

DOI QR Code

유니티 실시간 엔진과 End-to-End CNN 접근법을 이용한 자율주행차 학습환경

Autonomous-Driving Vehicle Learning Environments using Unity Real-time Engine and End-to-End CNN Approach

  • Hossain, Sabir (Center for Artificial Intelligence and Autonomous system, Mechanical Engineering, Kunsan National University) ;
  • Lee, Deok-Jin (Center for Artificial Intelligence and Autonomous system, Mechanical Engineering, Kunsan National University)
  • 투고 : 2018.12.21
  • 심사 : 2019.05.23
  • 발행 : 2019.05.31
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

Collecting a rich but meaningful training data plays a key role in machine learning and deep learning researches for a self-driving vehicle. This paper introduces a detailed overview of existing open-source simulators which could be used for training self-driving vehicles. After reviewing the simulators, we propose a new effective approach to make a synthetic autonomous vehicle simulation platform suitable for learning and training artificial intelligence algorithms. Specially, we develop a synthetic simulator with various realistic situations and weather conditions which make the autonomous shuttle to learn more realistic situations and handle some unexpected events. The virtual environment is the mimics of the activity of a genuine shuttle vehicle on a physical world. Instead of doing the whole experiment of training in the real physical world, scenarios in 3D virtual worlds are made to calculate the parameters and training the model. From the simulator, the user can obtain data for the various situation and utilize it for the training purpose. Flexible options are available to choose sensors, monitor the output and implement any autonomous driving algorithm. Finally, we verify the effectiveness of the developed simulator by implementing an end-to-end CNN algorithm for training a self-driving shuttle.

키워드

참고문헌

  1. L. Meeden, G. McGraw, and D. Blank, "Emergent control and planning in an autonomous vehicle," 15th Annual Conference of the Cognitive Science Society, 1993.
  2. P. Koopman and M. Wagner, "Challenges in autonomous vehicle testing and validation," SAE International Journal of Transportation Safety, vol. 4, no. 1, pp. 15-24, 2016, doi: 10.4271/2016-01-0128.
  3. E. Blana, "A survey of driving research simulators Around the World," Institute of Transport Studies, University of Leeds, Dec. 1996.
  4. X. Pan, Y. You, Z. Wang, and C. Lu, "Virtual to real reinforcement learning for autonomous driving," British Machine Version Conference (BMVC), pp. 11.1-11.13, Sept., 2017, doi: 10.5244/C.31.11.
  5. S. Hossain, A. R. Fayjie, O. Doukhi, and D.-J. Lee, "CAIAS simulator: self-driving vehicle simulator for AI research," International Conference on Intelligent Computing & Optimization, pp. 187-195, 2018, doi: 10.1007/978-3-030-00979-3_19.
  6. M. Bojarski, D. Del Testa, D. Dworakowski, B. Firner, B. Flepp, P. Goyal, L. D. Jackel, M. Monfort, U. Muller, J. Zhang, Xin Zhang, Jake Zhao, and Karol Zieba, "End to end learning for self-driving cars," arXiv:1604.07316 [cs.CV], 2016.
  7. Gazebo, [Online], http://gazebosim.org, Accessed: May 26, 2019.
  8. ROS.org, [Online], http://wiki.ros.org/gazebo, Accessed: May 26, 2019.
  9. T. Linner, A. Shrikathiresan, M. Vetrenko, B. Ellmann, and T. Bock, "Modeling and operating robotic environent using Gazebo/ROS," 28th international symposium on automation and robotics in construction (ISARC2011), pp. 957-962, Seoul, Korea, 2011, doi: 10.22260/ISARC2011/0177
  10. B. Wymann, C. Dimitrakakis, A. Sumner, E. Espie, and C. Guionneau, "Torcs, the open racing car simulator," TORCS: The open racing car simulator, Software available at http://torcs.sourceforge.net, Mar., 2015.
  11. A. Dosovitskiy, G. Ros, F. Codevilla, A. Lopez, and V. Koltun, "CARLA: An open urban driving simulator," arXiv:1711.03938 [cs.LG], 2017.
  12. S. Shah, D. Dey, C. Lovett, and A. Kapoor, "Airsim: High-fidelity visual and physical simulation for autonomous vehicles," Field and service robotics, pp. 621-635, 2018, doi: 10.1007/978-3-319-67361-5_40.
  13. Udacity, A self-driving car simulator built with Unity, [Online], https://github.com/udacity/self-driving-car-sim, Accessed: Dec. 14, 2018.
  14. V. De Luca, A. Meo, A. Mongelli, P. Vecchio, and L. T. De Paolis, "Development of a virtual simulator for microanastomosis: new opportunities and challenges," International Conference on Augmented Reality, Virtual Reality and Computer Graphics, pp. 65-81, 2016, doi: 10.1007/978-3-319-40651-0_6.
  15. L. Ni, Q. Peng, L. Yu, and J. Wang, "The research and application of products virtual exhibition technology base on unity 3D," Digital Technology and Application, vol. 9, p. 36, 2010.
  16. Y. Wang, Self-driving car simulation, [Online], http://wangyangevan.weebly.com/lidar-simulation.html, Accessed: Feb. 16, 2018.
  17. F. Codevilla, M. Miiller, A. Lopez, V. Koltun, and A. Dosovitskiy, "End-to-end driving via conditional imitation learning," in 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia, 2018, doi: 10.1109/icra.2018.8460487.
  18. S. v. d. Walt, S. C. Colbert, and G. Varoquaux, "The NumPy array: a structure for efficient numerical computation," Computing in Science & Engineering, vol. 13, no. 2, pp. 22-30, Mar.-Apr., 2011, doi: 10.1109/mcse.2011.37.
  19. A. Lorsakul and J. Suthakorn, "Traffic sign recognition using neural network on OpenCV: Toward intelligent vehicle/driver assistance system," Department of Biomedical Engineering, Faculty of Engineering, Mahidol University, Thailand, 2008.
  20. N. R. Pal and S. K. Pal, "A review on image segmentation techniques," Pattern recognition, vol. 26, no. 9, pp. 1277-1294, 1993, doi: 10.1016/0031-3203(93)90135-J.
  21. M. Hanggi, S. Moser, E. Pfaffhauser, and G. S. Moschytz, "Simulation and visualization of CNN dynamics," International Journal of Bifurcation and Chaos, vol. 9, no. 7, pp. 1237-1261, 1999, doi: 10.1142/s0218127499000882.

피인용 문헌

  1. Plant Disease Detection and Classification by Deep Learning vol.8, pp.11, 2019, https://doi.org/10.3390/plants8110468