Browse > Article
http://dx.doi.org/10.7780/kjrs.2021.37.5.1.26

Quickly Map Renewal through IPM-based Image Matching with High-Definition Map  

Kim, Duk-Jung (Department of Geoinformatics, University of Seoul)
Lee, Won-Jong (Department of Geoinformatics, University of Seoul)
Kim, Gi-Chang (Department of Geoinformatics, University of Seoul)
Choi, Yun-Soo (Department of Geoinformatics, University of Seoul)
Publication Information
Korean Journal of Remote Sensing / v.37, no.5_1, 2021 , pp. 1163-1175 More about this Journal
Abstract
In autonomous driving, road markings are an essential element for object tracking, path planning and they are able to provide important information for localization. This paper presents an approach to update and measure road surface markers with HD maps as well as matching using inverse perspective mapping. The IPM removes perspective effects from the vehicle's front camera image and remaps them to the 2D domain to create a bird-view region to fit with HD map regions. In addition, letters and arrows such as stop lines, crosswalks, dotted lines, and straight lines are recognized and compared to objects on the HD map to determine whether they are updated. The localization of a newly installed object can be obtained by referring to the measurement value of the surrounding object on the HD map. Therefore, we are able to obtain high accuracy update results with very low computational costs and low-cost cameras and GNSS/INS sensors alone.
Keywords
HD map; IPM; Localization; map update; GNSS; INS;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Vivacqua, R.P.D., M. Bertozzi, P. Cerri, F.N. Martins, and R.F. Vassallo, 2017. Self-localization based on visual lane marking maps: An accurate lowcost approach for autonomous driving, IEEE Transactions on Intelligent Transportation Systems, 19(2): 582-597.   DOI
2 Ziegler, J., P. Bender, T. Dang, and C. Stiller, 2014, Trajectory planning for bertha a local, continuous method, Proc. of 2014 IEEE intelligent vehicles symposium proceedings, Dearborn, MI, USA, Jun. 8-11, pp. 450-457.   DOI
3 Rebut, J., A. Bensrhair, and G. Toulminet, 2004, Image segmentation and pattern recognition for road marking analysis, Proc. of 2004 IEEE International Symposium on Industrial Electronics, Palais, FR, May. 4-7, Vol. 1, pp. 727-732.   DOI
4 Liu, Y.-C., K.-Y. Lin, and Y.-S. Chen, 2008, Bird's-Eye View Vision System for Vehicle Surrounding Monitoring, Proc. of RobVis 2008, Auckland, NZ, Feb. 18-20, pp. 207-218.   DOI
5 Seo, Y.-W. and R. Rajkumar, 2014, A vision system for detecting and tracking of stop-lines, Proc. of 17th IEEE International Conference on Intelligent Transportation Systems (ITSC), IEEE, 2014, Qingdao, CN, Oct. 8-11, pp. 1970-1975.
6 Marita, T., M. Negru, R. Danescu, and S. Nedevschi, 2010, stop-line detection and localization method for intersection scenarios, Proc. of IEEE International Conference on Intelligent Computer Communication and Processing, Cluj-Napoca, RO, Aug. 26-28, pp. 293-298.   DOI
7 Tan, S., J. Dale, A. Anderson, and A. Johnston, 2006, Inverse Perspective Mapping and Optic Flow: A Calibration Method and a Quantitative Analysis, Image and Vision Computing, 24(2) : 153-165.   DOI
8 Dornaika, F., J. Alvarez, A. Sappa, and A. Lopez, 2011, A new framework for stereo sensor pose through road segmentation and registration, IEEE Transactions on Intelligent Transportation Systems, 12(4): 954-966.   DOI
9 Guo, C., S. Mita, and D. McAllester, 2009, Stereovision-based road boundary detection for intelligent vehicles in challenging scenarios, Proc. of the IEEE International Conference on Intelligent Robots and Systems, St. Louis, MO, USA, Oct. 10-15, pp. 1723-1728.   DOI
10 Kluge, K. and S. Lakshamanan, 2005, A deformable-template approach to lane detection, Proc. of IEEE Intelligent Vehicles Symposium, Las Vegas, NV, USA, Jun. 6-8, pp. 54-59.
11 Muad, A.M., A. Hussain, S.A. Samad, M.M. Mustaffa, and B.Y. Majlis, 2004. Implementation of Inverse Perspective Mapping Algorithm for the Development of an Automatic Lane Tracking System, Proc. of IEEE Region 10 Conference TENCON, Chiang Mai, TH, Nov. 21-24, pp. 207-210.   DOI
12 Charbonnier, P., F. Diebolt, Y. Guillard, and F. Peyret, 1997, Road markings recognition using image processing, Proc. of IEEE Conference on Intelligent Transportatoin Systems, Boston, MA, USA, Nov. 12, pp. 912-917.   DOI
13 McCall, J.C. and M.M. Trivedi, 2004, An integrated robust approach to lane marking detection and lane tracking, Proc. of IEEE Intelligent Vehicles Symposium, Parma, IT, Jun. 14-17, pp. 533-537.   DOI
14 McCall, J.C. and M.M. Trivedi, 2006, Video-Based Lane Estimation and Tracking for Driver Assistance: Survey, System, and Evaluation, IEEE Transactions on Intelligent Transportation Systems, 7: 20-37.   DOI
15 Nieto, M., L. Salgado, F. Jaureguizar, and J. Cabrera, 2007, Stabilization of Inverse Perspective Mapping Images Based on Robust Vanishing Point Estimation, Proc. of IEEE Conference on Intelligent Vehicles Symposium, Istanbul, TR, Jun. 13-15 pp. 315-320.   DOI
16 Bertozzi, M., A. Broggi, and A. Fascioli, 1998, Stereo Inverse Perspective Mapping: Theory and Applications, Image and Vision Computing, 16: 585-590.   DOI
17 Braillon, C., 2006, Real-time moving obstacle detection using optical flow models, Proc. of IEEE Intelligent Vehicle Symposium (IV'00), Tokyo, JP, Jun. 13-15, pp. 466-471.   DOI
18 Heisele, B., 2000, Motion-based object detection and tracking in color images sequences, Proc. of Fourth Asian Conference on Computer Vision (ACCV'00), Taipei, CN, Jan. 8-11, Vol. 2, pp. 1028-1033.
19 Mallot, H.A., H.H. Bulthoff, J.J. Little, and S. Bohrer, 1991, Inverse Perspective Mapping Simplifies Optical Flow Computation and Obstacle Detection, Biological Cybernetics, 64(3): 177-185.   DOI
20 Rabie, T.F., G. Auda, A. El-Rabbany, A. Shalaby, and B. Abdulhai, 2001, Active-Vision-based Traffic Surveillance and Control, Rabie 2001 Active Visionbased TS, 2001: 1-7.
21 Schreiber, D., B. Alefs, and M. Clabian, 2005, Single Camera Lane Detection and Tracking, Proc. of IEEE Conference on Intelligent Transportation Systems, Vienna, AT, Sep. 13-16, pp. 302-307.
22 Welte, A., P. Xu, P. Bonnifait, and C. Zinoune, 2019, Estimating the reliability of georeferenced lane markings for map-aided localization, Proc. of 2019 IEEE Intelligent Vehicles Symposium (IV), Paris, FR, Jun. 9-12, pp. 1225-1231.
23 Poggenhans, F., N.O. Salscheider, and C. Stiller, 2018, Precise localization in high-definition roadmaps for urban regions, Proc. of 2018 IEEE/RSJ international conference on intelligent robots and systems, Madrid, ES, Oct. 1-5, pp. 2167-2174.   DOI
24 McCall, J.C. and M.M. Trivedi, 2005. Performance evaluation of a vision based lane tracker designed for driver assistance systems, Proc. of the IEEE Intelligent Vehicles Symposium, Las Vegas, NV, USA, Jun. 6-8, pp. 153-158.   DOI
25 Ma, W.-C., I. Tartavull, I.A. Barsan, S. Wang, M. Bai, G. Mattyus, and N. Homayounfar, S.K. Lakshmikanth, A. Pokrovsky, and R. Urtasun, 2019. Exploiting sparse semantic HD maps for self-driving vehicle localization, Proc. of International Conference on Intelligent Robots and Systems, Macau, CN, Nov. 3-8, pp. 5304-5311   DOI
26 Okada, R. and K. Onoguchi, 2003. Obstacle Detection Using Projective Invariant and Vanishing Lines, Proc. of 9th IEEE International Conference on Computer Vision (ICCV'03), Nice, FR, Oct. 13-16, pp. 330-337.   DOI
27 Vacec, S., C. Schimmel, and R. Dillman, 2007, Road-marking analysis for antonomous vehicle guidance, Proc. of European Conference on Mobile Robots 2007, Freiburg, DE. 19-21, pp. 1-6.
28 Stein, G. P., O. Mano, and A. Shashua, 2000, A robust method for computing vehicle ego-motion, Proc. of 2000 IEEE Intelligent Vehicle Symposium (IV'00), Piscataway, NJ, USA, Oct. 5, pp. 362-368.
29 Schreiber, M., C. Knoppel, and U. Franke, 2013, Laneloc: Lane marking based localization using highly accurate maps, Proc. of 2013 of IEEE Intelligent Vehicles Symposium (IV), Gold Coast City, AU, Jun, 26-28, pp. 449-454.   DOI