Journal of Digital Convergence (디지털융복합연구)

The Society of Digital Policy and Management (한국디지털정책학회)
권호 표지
DOI QR코드

DOI QR Code

Long Distance Vehicle License Plate Region Detection Using Low Resolution Feature of License Plate Region in Road View Images

로드뷰 영상에서 번호판 영역의 저해상도 특징을 이용한 원거리 자동차 번호판 영역 검출

  • 오명관 (혜전대학교 전기전자서비스과) ;
  • 박종천 (충북대학교 컴퓨터공학과)
  • Received : 2016.11.21
  • Accepted : 2017.01.20
  • Published : 2017.01.28
Download PDF
⟨ Previous Next ⟩

Abstract

For privacy protection, we propose a vehicle license plate region detection method in road view image served from portal site. Because vehicle license plate regions in road view images have different feature depending on distance, long distance vehicle license plate regions are not detected by feature of low resolution. Therefore, we suggest a method to detect short distance vehicle license plate regions by edge feature and long distance vehicle license plate regions using MSER feature. And then, we select candidate region of vehicle license plate region from detected region of each method, because the number of the vehicle license plate has a structural feature, we used it to detect the final vehicle license plate region. As the experiment result, we got a recall rate of 93%, precision rate of 75%, and F-Score rate of 80% in various road view images.

본 논문은 포털 사이트에서 서비스 되고 있는 로드뷰 영상에서 개인정보 보호를 위해 자동차 번호판 영역을 검출하는 방법을 제안한다. 로드뷰 영상에서 번호판 영역은 거리에 따라 서로 다른 특징을 갖고 있으며, 특히 원거리의 번호판 영역은 저해상도 특징으로 인해 번호판 영역을 검출하는데 어려움이 있다. 따라서 본 연구에서는 근거리에 있는 번호판 영역은 에지 특징을 이용하고 원거리에 있는 번호판 영역은 MSER 특징을 이용하여 번호판 영역을 검출하는 기법을 제안하였다. 각각의 방법으로 검출된 영역을 번호판 후보 영역으로 선정하고, 자동차 번호판의 숫자는 구조적 특징을 갖기 때문에 이를 이용하여 최종적인 번호판 영역을 검출하였다. 실험결과, 다양한 로드뷰 영상에서 precision 75%, recall 93%, 그리고 F-Score 80%의 성능평가 결과를 얻었다.

Keywords

References

  1. J. M. Yoon, D. J. Kim, "Car License Plate Detector Robust to Shape variation for Privacy Protection in Road View Service," proc. KIISE 2011 Autumn, vol. 38, no. 2(B), pp. 427-430, 2011.
  2. H. D. Moon, Y. C. Lee, D. I. Lee, "A Study on Worldwide & Korea Market Trends of Intelligent Transportation System" Electronics and telecommunications trends, vol. 17, no. 6, pp. 48-58, 2002.
  3. S. W. Jang, M. H. Huh1, "Mosaic Detection Based on Edge Projection in Digital Video," Journal of the Korea Academia-Industrial cooperation Society, vol. 17, no. 5, pp. 339-345, 2016. https://doi.org/10.5762/KAIS.2016.17.5.339
  4. D. D. Hwang, K. S. Lee, "A Study on Adaptive Skin Extraction using a Gradient Map and Saturation Features," Journal of the Korea Academia-Industrial cooperation Society, vol. 15, no. 7, pp. 4508-4515, 2014. https://doi.org/10.5762/KAIS.2014.15.7.4508
  5. S. J. Kang, Am-Seog Sur, Sung-Hwan Jeong, "Stop Object Method within Intersection with Using Adaptive Background Image," Journal of the Korea Academia-Industrial cooperation Society, vol. 14, no. 5, pp. 2430-2436, 2013. https://doi.org/10.5762/KAIS.2013.14.5.2430
  6. J. H. Ryu, J. H. Kim, C. G. Lee, "The navigation method of mobile robot using a omni-directional position detection system," Journal of the Korea Academia-Industrial cooperation Society, vol. 10, no. 2, pp. 237-242, 2009. https://doi.org/10.5762/KAIS.2009.10.2.237
  7. D. K. Kim, Chi-Jung Hwang, "Change Area Detection using Color and Edge Gradient Covariance Features," Journal of the Korea Academia-Industrial cooperation Society, vol. 17, no. 1, pp. 717-724, 2016. https://doi.org/10.5762/KAIS.2016.17.1.717
  8. D. K. Kim, "Moving Object Detection using Gaussian Pyramid based Subtraction Images in Road Video Sequences," Journal of the Korea Academia-Industrial cooperation Society, vol. 12, no. 12, pp. 5856-5864, 2011. https://doi.org/10.5762/KAIS.2011.12.12.5856
  9. S. W. Jang, M. H. Huh, "Target Object Detection Based on Robust Feature Extraction," Journal of the Korea Academia-Industrial cooperation Society, vol. 15, no. 12, pp. 7302-7308, 2014. https://doi.org/10.5762/KAIS.2014.15.12.7302
  10. S. W. Jang, S. W. Byun, "Detection of Special Effects with Circular Moving Borders," Journal of the Korea Academia-Industrial cooperation Society, vol. 12, no. 7, pp. 3184-3190, 2011. https://doi.org/10.5762/KAIS.2011.12.7.3184
  11. B. C. Jang, "A Study on Algorithm for Inspection of Automobile's plastic part locking lever," Journal of the Korea Academia-Industrial cooperation Society, vol. 11, no. 5, pp. 1558-1563, 2010. https://doi.org/10.5762/KAIS.2010.11.5.1558
  12. S. J. Kim, S. C. Lee, "Development of Inspection System for Surface of a Shock Absorber Rod using Machine vision," Journal of the Korea Academia-Industrial cooperation Society, vol. 15, no. 6, pp. 3416-3422, 2014. https://doi.org/10.5762/KAIS.2014.15.6.3416
  13. S. W. Jang, Y. J. Park, M. H. Huh, "Detection of Harmful Images Based on Color and Geometrical Features," Journal of the Korea Academia-Industrial cooperation Society, vol. 14, no. 11 pp. 5834-5840, 2013. https://doi.org/10.5762/KAIS.2013.14.11.5834
  14. C. S. Choi, M. G Min, B. M. Jun, "A Fast Iris Feature Extraction Method For Embedded System," Journal of the Korea Academia-Industrial cooperation Society, vol. 10, no. 1, pp. 128-134, 2009. https://doi.org/10.5762/KAIS.2009.10.1.128
  15. H. J. Park, "ROI Detection by Genetic Algorithm Based on Probability Map," Journal of the Korea Academia-Industrial cooperation Society, vol. 11, no. 8, pp. 3028-3035, 2010. https://doi.org/10.5762/KAIS.2010.11.8.3028
  16. Y. Yang, J. Bai, R. Tian, N. Liu, "A vehicle license plate recognition system based on fixed color collocation," Proc. of the 4th International Conference on Machine Learning and Cybernetics, pp. 5394-5397, Aug. 2005.
  17. S. Y. Kwon, B. H. Jun, "License-Plate Extraction from Parking Regulation Images using Intensity Vector and Composite Color," The Institute of Electronics and Information Engineers(CI), vol. 40, no. 6, pp. 47-55, 2003.
  18. T. D. Duan, D. A. Duc, T. L. H. Du, "Combining Hough transform and contour algorithm for detecting vehicles' license-plates," International Conference on Computer Systems and Technologies, pp. 747-750, Oct. 2004.
  19. J. H. Yun, M. R. Choi, S. S. Lee, "An image enhancement algorithm for detecting the license plate region using the image of the car personal recorder," Journal of the Korea Academia-Industrial cooperation Society, vol. 17, no. 3, pp. 1-8, 2016. https://doi.org/10.5762/KAIS.2016.17.3.1
  20. B. G. Kim, "Design of Improved UI of Automatic Parking Management System using License Plate Recognition," Journal of the Korea Academia-Industrial cooperation Society, vol. 15, no. 2, pp. 1083-1088, 2014. https://doi.org/10.5762/KAIS.2014.15.2.1083
  21. H. K. Yong, C. K. Kwon, M. S. Kim, "A Study On The Improvement Of Vehicle Plate Recognition," Journal of the Korea Academia-Industrial cooperation Society, vol. 10, no. 8, pp. 1947-1954, 2009. https://doi.org/10.5762/KAIS.2009.10.8.1947
  22. M. C. Jung, "Machine-printed Numeral Recognition using Weighted Template Matching," Journal of the Korea Academia-Industrial cooperation Society, vol. 10, no. 3, pp. 554-559, 2009. https://doi.org/10.5762/KAIS.2009.10.3.554
  23. Canny, John, "A Computational Approach to Edge Detection," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-8, no. 6, 1986, pp. 679-698. https://doi.org/10.1109/TPAMI.1986.4767851
  24. J. Matas, O. Chum, M. Urban, T. Pajdla., "Robust wide baseline stereo from maximally stable extremal regions," Proc. of British Machine Vision Conference, pp. 384-396, 2002.
  25. Nister, D., H. Stewenius, "Linear Time Maximally Stable Extremal Regions", Lecture Notes in Computer Science. 10th European Conference on Computer Vision, Marseille, France: no. 5303, pp. 183-196, 2008.
  26. Obdrzalek D., S. Basovnik, L. Mach, and A. Mikulik., "Detecting Scene Elements Using Maximally Stable Colour Regions," Communications in Computer and Information Science, La Ferte-Bernard, France; vol. 82 CCIS (2010 12 01), pp. 107-115, 2009.
  27. Mikolajczyk, K., T. Tuytelaars, C. Schmid, A. Zisserman, T. Kadir, and L. Van Gool, "A Comparison of Affine Region Detectors," International Journal of Computer Vision, vol. 65, no. 1-2, pp. 43-72, Nov. 2005. https://doi.org/10.1007/s11263-005-3848-x
  28. Y. W. Lee, H. S. Kim, W. U. Kang, G. H. Kim, "A Robust License Plate Extraction Method for Low Quality Images,", Journal of the Institute of Electronics Engineers of Korea SC, vol. 45, no. 2, pp. 8-17, 2008.
  29. Junker, M., R. Hoch, "On the Evaluation of Document analysis components by recall, precision, and accuracy, Proceedings of ICDAR, pp.713-716, 1999.
  30. J.G. Ha, H.J. Moon, "Performance Improvement for Robust Eye Detection Algorithm under Environmental Changes", Journal Of Digital Convergence, vol 14, no. 10, pp. 271-276, 2016. https://doi.org/10.14400/JDC.2016.14.10.271
  31. G.O. Kim, G.S. Lee, S. H. Lee, "An Edge Extraction Method Using K-means Clustering In Image", Journal Of Digital Convergence, vol. 12, no. 11, pp. 281-288, 2014. https://doi.org/10.14400/JDC.2014.12.11.281