• Korean Journal of Remote Sensing
• /
• v.37 no.5_1
• /
• pp.1163-1175
• /
• 2021

In autonomous driving, road markings are an essential element for object tracking, path planning and they are able to provide important information for localization. This paper presents an approach to update and measure road surface markers with HD maps as well as matching using inverse perspective mapping. The IPM removes perspective effects from the vehicle's front camera image and remaps them to the 2D domain to create a bird-view region to fit with HD map regions. In addition, letters and arrows such as stop lines, crosswalks, dotted lines, and straight lines are recognized and compared to objects on the HD map to determine whether they are updated. The localization of a newly installed object can be obtained by referring to the measurement value of the surrounding object on the HD map. Therefore, we are able to obtain high accuracy update results with very low computational costs and low-cost cameras and GNSS/INS sensors alone.

• Proceedings of the IEEK Conference
• /
• 2000.09a
• /
• pp.897-900
• /
• 2000

본 논문에서는 종방향 충돌경보 및 회피시스템(FCWA ; forward collision warning and avoidance)의 일환으로 가변적인 경사도를 가지는 고속도로상의 차선, 차량, 그리고 도로의 곡률을 효과적으로 검출할 수 있는 알고리듬을 제안하였다. 먼저 2D 영상좌표계에 나타나는 투영효과를 제거하기 위한 역투영(IPM; inverse perspective mapping)기법을 소개하였다. 또한 IPM과 필터로부터 차선과 차량을 효과적으로 검출할 수 있는 알고리듬을 소개하였다. 마지막으로 경사가 있는 실제도로영상에 대한 IMP의 수정된 파라미터 보정에 대한 개념 및 실제도로의 곡률 검출을 위한 기하학적 함수 추정기법을 설명하였다 실험결과 제안한 알고리듬이 실제도로영상에서 차선, 차량, 그리고 곡률의 검출에 효과적임을 확인할 수 있었다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2014.11a
• /
• pp.1199-1202
• /
• 2014

본 논문은 차량에 설치된 블랙박스 영상으로부터 도로 노면에 표시된 방향지시 기호를 효율적으로 검출하는 방안을 제안한다. 차량 내부에 설치된 블랙박스 영상은 카메라의 원근 효과로 인해 방향지시 기호 영역을 올바르게 검출하지 못하는 문제점이 존재한다. 따라서 제안한 연구에서는 원근 효과를 가진 입력 영상에서 역원근 변환 방법을 통해 원근 효과를 제거한 실세계 좌표로 맵핑한 평면 영상에서 방향지시 기호 영역을 신경망 검출기를 통해 검출한다. 입력 영상에서 역 원근 변환은 높은 계산량으로 인해 실시간 처리가 어려운 점이 존재한다. 이를 보완하기 위해 제안한 방안에서는 입력 영역의 도로노면 방향지시 기호 영역의 특징을 분석하여 도로노면 기호가 포함된 후보 ROI영역을 정의하고 후보 ROI 영역의 Gray 색상에서 역원근 변환을 수행한다. 제안한 방안을 도로노면 방향지시 기호 검출 및 인식 연구에 적용한 결과, 약 87% 이상 비교적 정확히 검출율을 제시하였으며, 다양한 도로 환경에서도 높은 검출율을 제시하였다. 따라서 제안한 방안을 운전자의 안전운전지원시스템에 적용함으로써 보다 정확한 도로정보 제공시스템 적용이 가능함을 알 수 있다.

• The Journal of The Korea Institute of Intelligent Transport Systems
• /
• v.20 no.5
• /
• pp.186-201
• /
• 2021

As autonomous driving technology advances, the accuracy of the vehicle position is important for recognizing the environments around driving. Map-matching localization techniques based on high definition (HD) maps have been studied to improve localization accuracy. Because conventional map-matching techniques estimate the vehicle position based on an HD map reference dataset representing the center of the lane, the estimated position does not reflect the deviation of the lateral distance within the lane. Therefore, this paper proposes a localization system based on the reference lateral position dataset extracted using image processing and HD maps. Image processing extracts the driving lane number using inverse perspective mapping, multi-lane detection, and yellow central lane detection. The lane departure method estimates the lateral distance within the lane. To collect the lateral position reference dataset, this approach involves two processes: (i) the link and lane node is extracted based on the lane number obtained from image processing and position from GNSS/INS, and (ii) the lateral position is matched with the extracted link and lane node. Finally, the vehicle position is estimated by matching the GNSS/INS local trajectory and the reference lateral position dataset. The performance of the proposed method was evaluated by experiments carried out on a highway environment. It was confirmed that the proposed method improves accuracy by about 1.0m compared to GNSS / INS, and improves accuracy by about 0.04m~0.21m (7~30%) for each section when compared with the existing lane-level map matching method.

• International Journal of Automotive Technology
• /
• v.8 no.4
• /
• pp.493-504
• /
• 2007

This paper proposes a stereo vision-based forward obstacle detection and distance measurement method. In general, stereo vision-based obstacle detection methods in automotive applications can be classified into two categories: IPM (Inverse Perspective Mapping)-based and disparity histogram-based. The existing disparity histogram-based method was developed for stop-and-go applications. The proposed method extends the scope of the disparity histogram-based method to highway applications by 1) replacing the fixed rectangular ROI (Region Of Interest) with the traveling lane-based ROI, and 2) replacing the peak detection with a constant threshold with peak detection using the threshold-line and peakness evaluation. In order to increase the true positive rate while decreasing the false positive rate, multiple candidate peaks were generated and then verified by the edge feature correlation method. By testing the proposed method with images captured on the highway, it was shown that the proposed method was able to overcome problems in previous implementations while being applied successfully to highway collision warning/avoidance conditions, In addition, comparisons with laser radar showed that vision sensors with a wider FOV (Field Of View) provided faster responses to cutting-in vehicles. Finally, we integrated the proposed method into a longitudinal collision avoidance system. Experimental results showed that activated braking by risk assessment using the state of the ego-vehicle and measuring the distance to upcoming obstacles could successfully prevent collisions.

• Transactions of the Korean Society of Automotive Engineers
• /
• v.8 no.6
• /
• pp.194-207
• /
• 2000

In this paper, we suggest a vision-based lane change control system, which can be applied on the straight road, without additional sensors such as a yaw rate sensor and a lateral accelerometer. In order to reduce the image processing time, we predict a reference line position during lane change using the lateral dynamics and the inverse perspective mapping. The sliding mode control algorithm with a boundary layer is adopted to overcome variations of parameters that significantly affects a vehicle`s lateral dynamics and to reduce chattering phenomenon. However, applying the sliding mode control to the system with a long sampling interval, the stability of a control system may seriously be affected by the sampling interval. Therefore, in this paper, a look ahead offset has been used instead of a lateral offset to reduce the effect of the long sampling interval due to the image processing time. The control algorithm is developed to follow the desired trajectory designed in advance. In the design of the desired trajectory, we take account of the constraints of lateral acceleration and lateral jerk for ride comfort. The performance of the suggested control system is evaluated in simulations as well as field tests.

• Journal of Institute of Control, Robotics and Systems
• /
• v.21 no.9
• /
• pp.858-862
• /
• 2015

This paper presents a new forward-viewing mono-camera based obstacle detection algorithm for mobile robots. The proposed method extracts the coarse location of an obstacle in an image using inverse perspective mapping technique from sequential images. In the next step, graph-cut based image labeling is conducted for estimating the exact obstacle boundary. The graph-cut based labeling algorithm labels the image pixels as either obstacle or floor as the final outcome. Experiments are performed to verify the obstacle detection performance of the developed algorithm in several examples, including a book, box, towel, and flower pot. The low illumination condition, low color contrast between floor and obstacle, and floor pattern cases are also tested.

• Journal of Institute of Control, Robotics and Systems
• /
• v.22 no.12
• /
• pp.1061-1067
• /
• 2016

Position of the vehicle for driving is essential to autonomous navigation. However, there appears GPS position error due to multipath which is occurred by tall buildings in downtown area. In this paper, GPS position error is corrected by using camera sensor and highly accurate map made with 3D-Lidar. Input image through inverse perspective mapping is converted into top-view image, and it works out map matching with the map which has intensity of 3D-Lidar. Performance comparison was conducted between this method and traditional way which does map matching with input image after conversion of map to pinhole camera image. As a result, longitudinal error declined 49% and complexity declined 90%.

• Transactions of the Korean Society of Automotive Engineers
• /
• v.22 no.7
• /
• pp.40-47
• /
• 2014

This paper proposes a matching method of GIS lane information with a vehicle position using camera image to reduce DGPS error. Images of straight road are taken using a camera that is installed on the front center of the vehicle, and the distance between the vehicle and the lane are estimated using the images. The current GIS lane data is matched by comparing the estimated distance and the measured distance using a DGPS. Inverse perspective mapping is used to minimize the error of image processing from the heading angle, and single buffering method is applied to decide the exact moment of GIS match. Through practical test on the highway, feasibility of the GIS matching using camera image is confirmed.

• The Journal of Korea Institute of Information, Electronics, and Communication Technology
• /
• v.10 no.4
• /
• pp.304-310
• /
• 2017

In this paper, we propose the architecture of an IPM based lane detector for autonomous vehicles to detect and control the driving route along the curved lane. In the IPM image, we divide the area into two fields, Far/Near Field, and the lane candidate region is detected using the Hough transform to perform the matching for the curved lane. In autonomous vehicles, various algorithms must be embedded in the system. To reduce the system resources, we proposed a method to minimize the number of memory accesses to the image and various parameters on the external memory. The proposed circuit has 96% lane recognition rate and occupies 16% LUT, 5.9% FF and 29% BRAM in Xilinx XC7Z020. It processes Full-HD image at a rate of 42 fps at a 100 MHz operating clock.