ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Parking Space Recognition for Autonomous Valet Parking Using Height and Salient-Line Probability Maps

  • Han, Seung-Jun (IT Convergence Technology Research Laboratory, ETRI) ;
  • Choi, Jeongdan (IT Convergence Technology Research Laboratory, ETRI)
  • Received : 2014.08.09
  • Accepted : 2015.08.21
  • Published : 2015.12.01
Download PDF
⟨ Previous Next ⟩

Abstract

An autonomous valet parking (AVP) system is designed to locate a vacant parking space and park the vehicle in which it resides on behalf of the driver, once the driver has left the vehicle. In addition, the AVP is able to direct the vehicle to a location desired by the driver when requested. In this paper, for an AVP system, we introduce technology to recognize a parking space using image sensors. The proposed technology is mainly divided into three parts. First, spatial analysis is carried out using a height map that is based on dense motion stereo. Second, modelling of road markings is conducted using a probability map with a new salient-line feature extractor. Finally, parking space recognition is based on a Bayesian classifier. The experimental results show an execution time of up to 10 ms and a recognition rate of over 99%. Also, the performance and properties of the proposed technology were evaluated with a variety of data. Our algorithms, which are part of the proposed technology, are expected to apply to various research areas regarding autonomous vehicles, such as map generation, road marking recognition, localization, and environment recognition.

Keywords

References

  1. G. Meyer and S. Deix "Research and Innovation for Automated Driving in Germany and Europe," in Road Vehicle Autom., Berlin, Germany: Springer, 2014, pp. 71-81.
  2. B.W. Smith, "Automated Vehicles are Probably Legal in the United States," Preprint, submitted Aug. 1, 2013. http://ssrn.com/abstract=2303904
  3. K.W. Min and J. Choi, "A Control System for Autonomous Vehicle Valet Parking," Int. Conf. Contr., Autom. Syst., Gwangju, Rep. of Korea, Oct. 20-23, 2013, pp. 1714-1717.
  4. W. Park et al., "Parking Space Detection Using Ultrasonic Sensor in Parking Assistance System," IEEE Intell. Veh. Symp., Eindhoven, Netherlands, June 4-6, 2008, pp. 1039-1044.
  5. S.H. Jeong et al., "Low Cost Design of Parallel Parking Assist System Based on an Ultrasonic Sensor," Int. J. Autom. Technol., vol. 11, no. 3, June 2010, pp. 409-416. https://doi.org/10.1007/s12239-010-0050-0
  6. H.G. Jung et al., "Scanning Laser Radar-Based Target Position Designation for Parking Aid System," IEEE Trans. Intell. Transp. Syst., vol. 9, no. 3, Sept. 2008, pp. 406-424. https://doi.org/10.1109/TITS.2008.922980
  7. J. Zhou, L.E. Navarro-Serment, and M. Hebert, "Detection of Parking Spots Using 2D Range Data," IEEE Int. Conf. Intell. Transp. Syst., Anchorage, AK, USA, Sept. 16-19, 2012, pp. 1280-1287.
  8. S. Gorner and H. Rohling, "Parking Lot Detection with 24 GHz Radar Sensor," Int. Workshop Intell. Transp., Hamburg, Germany, Mar. 14, 2006, pp. 1-6.
  9. M.R. Schmid et al., "Parking Space Detection with Hierarchical Dynamic Occupancy Grids," IEEE Intell. Veh. Symp., Baden-Baden, Germany, June 5-9, 2011, pp. 254-259.
  10. N. Kaempchen, U. Franke, and R. Ott, "Stereo Vision Based Pose Estimation of Parking Lots Using 3D Vehicle Models," IEEE Intell. Veh. Symp., Versailles, France, June 17-21, 2002, pp. 459-464.
  11. J.K. Suhr et al., "Automatic Free Parking Space Detection by Using Motion Stereo-Based 3D Reconstruction," Mach. Vis. Appl., vol. 21, no. 2, Feb. 2010, pp. 163-176. https://doi.org/10.1007/s00138-008-0156-9
  12. C. Unger, E. Wahl, and S. Ilic, "Parking Assistance Using Dense Motion-Stereo," Mach. Vis. Appl., Apr. 2014, vol. 25, no 3, pp. 561-581. https://doi.org/10.1007/s00138-011-0385-1
  13. H.G. Jung et al., "Parking Slot Markings Recognition for Automatic Parking Assist System," IEEE Intell. Veh. Symp., Tokyo, Japan, June 13-15, 2006, pp. 106-113.
  14. C. Wang et al., "Automatic Parking Based on a Bird's Eye View Vision System," Adv. Mech. Eng., vol. 2014, 2014, pp 1-3.
  15. J.K. Suhr and H.G. Jung, "Full-Automatic Recognition of Various Parking Slot Markings Using a Hierarchical Tree Structure," Opt. Eng., vol. 52, no. 3, Mar. 2013, pp. 1-14.
  16. J.K. Suhr and H.G. Jung, "Sensor Fusion-Based Vacant Parking Slot Detection and Tracking," IEEE Trans. Intell. Transp. Syst., vol. 15, no. 1, Feb. 2014, pp. 21-36. https://doi.org/10.1109/TITS.2013.2272100
  17. S.-J. Han, J. Kim, and J. Choi, "Effective Height-Grid Map Building Using Inverse Perspective Image," IEEE Intell. Veh. Symp., Seoul, Rep. of Korea, June 28-July 1, 2015, pp. 549-554.
  18. E. Elboher and M. Werman, "Efficient and Accurate Gaussian Image Filtering Using Running Sums," Intell. Sys. Des. Appl., Kochi, India, Nov. 27-29, 2012, pp. 897-902.
  19. L. Gorman, M. Sammon, and M. Seul, "Practical Algorithms for Image Analysis," 2nd Ed., New York, USA: Cambridge University Press, 2008, pp. 118-125.
  20. S.-J. Han and J. Choi, "Real-Time Precision Vehicle Localization Using Numerical Maps," ETRI J., vol. 36, no. 6, Dec. 2014, pp. 968-978. https://doi.org/10.4218/etrij.14.0114.0040
  21. K.P. Murphy, "Machine Learning: A Probabilistic Perspective," Cambridge, MA, USA: MIT Press, 2012, pp. 151-186.
  22. H.S. Lee, J.H. Yoo, and D.H. Park, "Data Clustering Method Using a Modified Gaussian Kernel Metric and Kernel PCA," ETRI J., vol. 36, no. 3, June 2014, pp. 333-342. https://doi.org/10.4218/etrij.14.0113.0553
  23. N. Einecke and J. Eggert, "A Two-Stage Correlation Method for Stereoscopic Depth Estimation," IEEE Int. Conf. Digital Image Comput: Techn. Appl., Sydney, Australia, Dec. 1-3, 2010, pp. 227-234.
  24. Q. Yang, "Hardware-Efficient Bilateral Filtering for Stereo Matching," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 5, May 2014, pp. 1026-1032. https://doi.org/10.1109/TPAMI.2013.186
  25. A. Geiger, M. Roser, and R. Urtasun, "Efficient Large-Scale Stereo Matching," Asian Conf. Comput. Vis., Queenstown, New Zealand, Nov. 8-12, 2010, pp. 25-38.
  26. T. Veit et al., "Evaluation of Road Marking Feature Extraction," IEEE Int. Conf. Intel. Transp. Syst., Beijing, China, Oct. 12-15, 2008, pp. 174-181.

Cited by

  1. Analysis of vehicle static steering torque based on tire-road contact patch sliding model and variable transmission ratio vol.8, pp.9, 2015, https://doi.org/10.1177/1687814016668765
  2. Semantic segmentation-based parking space detection with standalone around view monitoring system vol.30, pp.2, 2019, https://doi.org/10.1007/s00138-018-0986-z
  3. A Study on the Parking Point Searching for Wireless Charging of Electric Vehicles vol.28, pp.7, 2015, https://doi.org/10.7467/ksae.2020.28.7.483
  4. A Trajectory Planning Method for Autonomous Valet Parking via Solving an Optimal Control Problem vol.20, pp.22, 2015, https://doi.org/10.3390/s20226435
  5. Specular Detection on Glossy Surface Using Geometric Characteristics of Specularity in Top-View Images vol.21, pp.6, 2015, https://doi.org/10.3390/s21062079
  6. Multi-Sensor Information Ensemble-Based Automatic Parking System for Vehicle Parallel/Nonparallel Initial State vol.21, pp.7, 2015, https://doi.org/10.3390/s21072261
  7. Multi-Input Deep Learning Based FMCW Radar Signal Classification vol.10, pp.10, 2015, https://doi.org/10.3390/electronics10101144