• Title/Summary/Keyword: Carla simulator

Search Result 5, Processing Time 0.016 seconds

Panorama Image Stitching Using Sythetic Fisheye Image (Synthetic fisheye 이미지를 이용한 360° 파노라마 이미지 스티칭)

  • Kweon, Hyeok-Joon;Cho, Donghyeon
    • Journal of Broadcast Engineering
    • /
    • v.27 no.1
    • /
    • pp.20-30
    • /
    • 2022
  • Recently, as VR (Virtual Reality) technology has been in the spotlight, 360° panoramic images that can view lively VR contents are attracting a lot of attention. Image stitching technology is a major technology for producing 360° panorama images, and many studies are being actively conducted. Typical stitching algorithms are based on feature point-based image stitching. However, conventional feature point-based image stitching methods have a problem that stitching results are intensely affected by feature points. To solve this problem, deep learning-based image stitching technologies have recently been studied, but there are still many problems when there are few overlapping areas between images or large parallax. In addition, there is a limit to complete supervised learning because labeled ground-truth panorama images cannot be obtained in a real environment. Therefore, we produced three fisheye images with different camera centers and corresponding ground truth image through carla simulator that is widely used in the autonomous driving field. We propose image stitching model that creates a 360° panorama image with the produced fisheye image. The final experimental results are virtual datasets configured similar to the actual environment, verifying stitching results that are strong against various environments and large parallax.

A Study on Real-time Autonomous Driving Simulation System Construction based on Digital Twin - Focused on Busan EDC - (디지털트윈 기반 실시간 자율주행 시뮬레이션 시스템 구축 방안 연구 - 부산 EDC 중심으로 -)

  • Kim, Min-Soo;Park, Jong-Hyun;Sim, Min-Seok
    • Journal of Cadastre & Land InformatiX
    • /
    • v.53 no.2
    • /
    • pp.53-66
    • /
    • 2023
  • Recently, there has been a significant interest in the development of autonomous driving simulation environment based on digital twin. In the development of such digital twin-based simulation environment, many researches has been conducted not only performance and functionality validation of autonomous driving, but also generation of virtual training data for deep learning. However, such digital twin-based autonomous driving simulation system has the problem of requiring a significant amount of time and cost for the system development and the data construction. Therefore, in this research, we aim to propose a method for rapidly designing and implementing a digital twin-based autonomous driving simulation system, using only the existing 3D models and high-definition map. Specifically, we propose a method for integrating 3D model of FBX and NGII HD Map for the Busan EDC area into CARLA, and a method for adding and modifying CARLA functions. The results of this research show that it is possible to rapidly design and implement the simulation system at a low cost by using the existing 3D models and NGII HD map. Also, the results show that our system can support various functions such as simulation scenario configuration, user-defined driving, and real-time simulation of traffic light states. We expect that usability of the system will be significantly improved when it is applied to broader geographical area in the future.

Personal Driving Style based ADAS Customization using Machine Learning for Public Driving Safety

  • Giyoung Hwang;Dongjun Jung;Yunyeong Goh;Jong-Moon Chung
    • Journal of Internet Computing and Services
    • /
    • v.24 no.1
    • /
    • pp.39-47
    • /
    • 2023
  • The development of autonomous driving and Advanced Driver Assistance System (ADAS) technology has grown rapidly in recent years. As most traffic accidents occur due to human error, self-driving vehicles can drastically reduce the number of accidents and crashes that occur on the roads today. Obviously, technical advancements in autonomous driving can lead to improved public driving safety. However, due to the current limitations in technology and lack of public trust in self-driving cars (and drones), the actual use of Autonomous Vehicles (AVs) is still significantly low. According to prior studies, people's acceptance of an AV is mainly determined by trust. It is proven that people still feel much more comfortable in personalized ADAS, designed with the way people drive. Based on such needs, a new attempt for a customized ADAS considering each driver's driving style is proposed in this paper. Each driver's behavior is divided into two categories: assertive and defensive. In this paper, a novel customized ADAS algorithm with high classification accuracy is designed, which divides each driver based on their driving style. Each driver's driving data is collected and simulated using CARLA, which is an open-source autonomous driving simulator. In addition, Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) machine learning algorithms are used to optimize the ADAS parameters. The proposed scheme results in a high classification accuracy of time series driving data. Furthermore, among the vast amount of CARLA-based feature data extracted from the drivers, distinguishable driving features are collected selectively using Support Vector Machine (SVM) technology by comparing the amount of influence on the classification of the two categories. Therefore, by extracting distinguishable features and eliminating outliers using SVM, the classification accuracy is significantly improved. Based on this classification, the ADAS sensors can be made more sensitive for the case of assertive drivers, enabling more advanced driving safety support. The proposed technology of this paper is especially important because currently, the state-of-the-art level of autonomous driving is at level 3 (based on the SAE International driving automation standards), which requires advanced functions that can assist drivers using ADAS technology.

A Study on Data Model Conversion Method for the Application of Autonomous Driving of Various Kinds of HD Map (다양한 정밀도로지도의 자율주행 적용을 위한 데이터 모델 변환 방안 연구)

  • Lee, Min-Hee;Jang, In-Sung;Kim, Min-Soo
    • Journal of Cadastre & Land InformatiX
    • /
    • v.51 no.1
    • /
    • pp.39-51
    • /
    • 2021
  • Recently, there has been much interest in practical use of standardized HD map that can effectively define roads, lanes, junctions, road signs, and road facilities in autonomous driving. Various kinds of de jure or de facto standards such as ISO 22726-1, ISO 14296, HERE HD Live map, NDS open lane model, OpenDRIVE, and NGII HD map are currently being used. However, there are lots of differences in data modeling among these standards, it makes difficult to use them together in autonomous driving. Therefore, we propose a data model conversion method to enable an efficient use of various kinds of HD map standards in autonomous driving in this study. Specifically, we propose a conversion method between the NGII HD map model, which is easily accessible in the country, and the OpenDRIVE model, which is commonly used in the autonomous driving industry. The proposed method consists of simple conversion of NGII HD map layers into OpenDRIVE objects, new OpenDRIVE objects creation corresponding to NGII HD map layers, and linear transformation of NGII HD map layers for OpenDRIVE objects creation. Finally, we converted some test data of NGII HD map into OpenDRIVE objects, and checked the conversion results through Carla simulator. We expect that the proposed method will greatly contribute to improving the use of NGII HD map in autonomous driving.

Study on Map Building Performance Using OSM in Virtual Environment for Application to Self-Driving Vehicle (가상환경에서 OSM을 활용한 자율주행 실증 맵 성능 연구)

  • MinHyeok Baek;Jinu Pahk;JungSeok Shim;SeongJeong Park;YongSeob Lim;GyeungHo Choi
    • Journal of Auto-vehicle Safety Association
    • /
    • v.15 no.2
    • /
    • pp.42-48
    • /
    • 2023
  • In recent years, automated vehicles have garnered attention in the multidisciplinary research field, promising increased safety on the road and new opportunities for passengers. High-Definition (HD) maps have been in development for many years as they offer roadmaps with inch-perfect accuracy and high environmental fidelity, containing precise information about pedestrian crossings, traffic lights/signs, barriers, and more. Demonstrating autonomous driving requires verification of driving on actual roads, but this can be challenging, time-consuming, and costly. To overcome these obstacles, creating HD maps of real roads in a simulation and conducting virtual driving has become an alternative solution. However, existing HD maps using high-precision data are expensive and time-consuming to build, which limits their verification in various environments and on different roads. Thus, it is challenging to demonstrate autonomous driving on anything other than extremely limited roads and environments. In this paper, we propose a new and simple method for implementing HD maps that are more accessible for autonomous driving demonstrations. Our HD map combines the CARLA simulator and OpenStreetMap (OSM) data, which are both open-source, allowing for the creation of HD maps containing high-accuracy road information globally with minimal dependence. Our results show that our easily accessible HD map has an accuracy of 98.28% for longitudinal length on straight roads and 98.42% on curved roads. Moreover, the accuracy for the lateral direction for the road width represented 100% compared to the manual method reflected with the exact road data. The proposed method can contribute to the advancement of autonomous driving and enable its demonstration in diverse environments and on various roads.