Browse > Article
http://dx.doi.org/10.21289/KSIC.2021.24.6.699

A Study on Vehicle License Plate Recognition System through Fake License Plate Generator in YOLOv5  

Ha, Sang-Hyun (Dept, of Artificial Intelligence, Dong-Eui University)
Jeong, Seok Chan (AI Grand ICT Research Center, Dept. e-Business, Dong-Eui University)
Jeon, Young-Joon (Convergence of IT Devices Institute Busan, Dong-Eui University)
Jang, Mun-Seok (Dept. of AI Electronic Engineering, Dong-Eui Institute of Technology)
Publication Information
Journal of the Korean Society of Industry Convergence / v.24, no.6_2, 2021 , pp. 699-706 More about this Journal
Abstract
Existing license plate recognition system is used as an optical character recognition method, but a method of using deep learning has been proposed in recent studies because it has problems with image quality and Korean misrecognition. This requires a lot of data collection, but the collection of license plates is not easy to collect due to the problem of the Personal Information Protection Act, and labeling work to designate the location of individual license plates is required, but it also requires a lot of time. Therefore, in this paper, to solve this problem, five types of license plates were created using a virtual Korean license plate generation program according to the notice of the Ministry of Land, Infrastructure and Transport. And the generated license plate is synthesized in the license plate part of collectable vehicle images to construct 10,147 learning data to be used in deep learning. The learning data classifies license plates, Korean, and numbers into individual classes and learn using YOLOv5. Since the proposed method recognizes letters and numbers individually, if the font does not change, it can be recognized even if the license plate standard changes or the number of characters increases. As a result of the experiment, an accuracy of 96.82% was obtained, and it can be applied not only to the learned license plate but also to new types of license plates such as new license plates and eco-friendly license plates.
Keywords
License Plate; License Plate Generator; LPR(License Plate Recognition); YOLO(You Only Look Once); Object Detection; Deep Learning;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Tang Quang Hieu, 연승호, 김재민, "CNN기반 한국 번호판 인식", 전기전자학회논문지, 23, 4, pp. 222-227, (2019).
2 Ross Girshick, Jeff Donahue, Trevor Darrell, Jitendra Malik, UC Berkeley, "Rich feature hierarchies for accurate object detection and semantic segmentation", CVPR, pp. 1-10, (2014).
3 김남우, 허창우, "Emgu CV를 이용한 자동차 번호판 자동 인식 프로그램의 성능 평가에 관한 연구", 한국정보기술학회논문지, 20, 6, pp. 1209-1214, (2016).
4 신현경, "카메라 영상 위에서의 문자 영역 추출 및 OCR", 정보처리학회논문지D, 17, 1, pp. 59-66, (2010).
5 김재정, 김창복, "YOLO와 CNN을 이용한 강인한 차량 번호판 인식 시스템 구현", 학국정보기술학회논문지, 19, 4, pp. 1-9, (2021).
6 김정환, 임준홍, "딥러닝을 이용한 번호판 검출과 인식 알고리즘", 전기전자학회논문지, 23, 2, pp. 642-651, (2019).   DOI
7 김운기, Fatemeh Dehghan, 조성원, "SSD -Mobilenet 과 ResNet을 이용한 모바일 기기용 자동차 번호판 인식시스템", 스마트미디어저널, 9, 2, pp. 92-98, (2020).   DOI
8 Shaoqing Ren, Kaiming He, Ross Girshick, Jian Sun, "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks", "arxiv.org/abs/1506.01497" (2015).
9 Joseph Redmon, Santosh Divvala, Ross Girshick, Ali Farhadi, "You Only Look Once: Unified, Real-Time Object Detection", pp. 1-10, "arxiv.org/abs/1506.02640" (2016).
10 Jifeng Dai, Yi Li, Kaiming He, Jian Sun, "R-FCN: Object Detection via Region - based Fully Convolutional Networks", "arxiv.org/1605.06409" (2016).
11 Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, Piotr Dollar, "Focal Loss for Dense Object Detection", "arxiv.org/abs/1708.02002" (2017).
12 이승주, 박구만, "가상 데이터를 활용한 번호판 문자 인식 및 차종 인식 시스템 제안", 방송공학회논문지, 25, 4, pp. 776-788, (2020).
13 이재현, 조성만, 이승주, 김청화, 박구만, "인조 데이터를 활용한 차량 번호판 인식 시스템", 전자공학회논문지, 57, 1, pp. 107-115, (2020).
14 Ross Girshick, "Fast R-CNN", ICCV, (2015).
15 Korean License Plate Generator, "https://github.com/yakhyo/Korean-License-Plate-Generator"
16 국토교통부 고시 제2020-344호, "https://www.law.go.kr/", (2020).
17 채호열, 석호식, "OCR 엔진 기반 분류기 애드온 결합을 통한 이미지 내부 텍스트 인식 성능 향상", 전기전자학회논문지, 24, 4, pp. 166-172, (2020).
18 Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, Alexander C. Berg, "SSD: Single Shot MultiBox Detector", "arxiv.org/abs/1512.02325" (2015).