Browse > Article
http://dx.doi.org/10.3745/KTSDE.2016.5.11.511

Real-Time License Plate Detection Based on Faster R-CNN  

Lee, Dongsuk (전북대학교 IT 융합연구센터)
Yoon, Sook (목포대학교 멀티미디어공학과)
Lee, Jaehwan (전북대학교 전자정보공학부)
Park, Dong Sun (전북대학교 전자공학부)
Publication Information
KIPS Transactions on Software and Data Engineering / v.5, no.11, 2016 , pp. 511-520 More about this Journal
Abstract
Automatic License Plate Detection (ALPD) is a key technology for a efficient traffic control. It is used to improve work efficiency in many applications such as toll payment systems and parking and traffic management. Until recently, the hand-crafted features made for image processing are used to detect license plates in most studies. It has the advantage in speed. but can degrade the detection rate with respect to various environmental changes. In this paper, we propose a way to utilize a Faster Region based Convolutional Neural Networks (Faster R-CNN) and a Conventional Convolutional Neural Networks (CNN), which improves the computational speed and is robust against changed environments. The module based on Faster R-CNN is used to detect license plate candidate regions from images and is followed by the module based on CNN to remove False Positives from the candidates. As a result, we achieved a detection rate of 99.94% from images captured under various environments. In addition, the average operating speed is 80ms/image. We implemented a fast and robust Real-Time License Plate Detection System.
Keywords
License Plate; Deep Learning; Convolutional Neural Network; Faster Region Based Convolutional Neural Network;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 K. Deb and J. Kang-Hyun, "HSI color based vehicle license plate detection," in Control, Automation and Systems, 2008. ICCAS 2008. International Conference on, pp.687-691, 2008.
2 L. Dlagnekov, "License Plate Detection Using AdaBoost," San Diego, CA: Computer Science and Engineering Dept., 2004.
3 S. Z. Wang and H. J. Lee, "A cascade framework for a real-time statistical plate recognition system," IEEE Trans. Inform. Forensics Security, Vol.2, No.2, pp.267-282, 2007.   DOI
4 C. D. Nguyen, M. Ardabilian, and L. Chen, "Robust Car License Plate Localization Using a Novel Texture Descriptor," IEEE International Conference on Advanced Video and Signal Based Surveillance, pp.523-528, 2009.
5 N. Dalal and B. Triggs, "Histograms of Oriented Gradients for Human Detection," IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp.886-893, 2005.
6 최인수, 진문용, 박동선, "모폴로지 연산과 신명망 시스템을 이용한 차량 번호판 검출 및 숫자 인식," 스마트미디어학회, 2013 순천 정원엑스포 ICT 합동학술대회 논문집, 제2권, 제1호, pp.58-61, 2013.
7 M. Sarfraz, M. J. Ahmed, and S. A. Ghazi, "Saudi Arabian license plate recognition system," in Proc. Int. Conf. Geom. Model. Graph., pp.36-41, 2003.
8 A. M. Al-Ghaili, S. Mashohor, A. Ismail, and A. R. Ramli, "A new vertical edge detection algorithm and its application," in Proc. Int. Conf. Comput. Eng. Syst., pp.204-209, 2008.
9 P. Wu, H.-H. Chen, R.-J. Wu, and D.-F. Shen, "License plate extraction in low resolution video," in Proc. Int. Conf. Pattern Recognit., Vol.1, pp.824-827, 2006.
10 V. Kamat and S. Ganesan, "An efficient implementation of the Hough transform for detecting vehicle license plates using DSPs," in Proc. Real-Time Tech. Applicat. Symp., pp.58-59, 1995.
11 Hui Li and Chunhua Shen, "Reading Car License Plates Using Deep Convolutional Neural Networks and LSTMs," arXiv arXiv:1601.05610v1 [cs.CV].
12 W. T. Ho, H. W. Lim, and Y. H. Tay, "Two-Stage License Plate Detection Using Gentle Adaboost and SIFT-SVM," First Asian Conference on Intelligent Information and Database Systems, pp.109-114, 2009.
13 S. Ren, K. He, R. Girshick, and J. Sun, "Faster r-cnn: Towards real-time object detection with region proposal networks," arXiv preprint arXiv:1506.01497, 2015.
14 M. D. Zeiler and R. Fergus, "Visualizing and understanding convolutional neural networks," in European Conference on Computer Vision (ECCV), 2014.
15 G. E. Hinton, S. Osindero, and Y. W. Teh, "A fast learning algorithm for deep belief nets," Neural Comput., Vol.18, No. 7, pp.1527-1554, 2006.   DOI
16 A. Krizhevsky, I. Sutskever, and G. Hinton, "Imagenet classification with deep convolutional neural networks," in Advances in Neural Information Processing Systems 25, pp.1106-1114, 2012.
17 K. He, X. Zhang, S. Ren, and J. Sun, "Spatial pyramid pooling in deep convolutional networks for visual recognition," in ECCV, 2014.
18 C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. "Going deeper with convolutions," in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR),, pp.1-9, 2015.
19 K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition," in ICLR, 2015.
20 R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Region based convolutional networks for accurate object detection and segmentation," TPAMI, 2015.
21 R. Girshick, "Fast R-CNN," in IEEE International Conference on Computer Vision (ICCV), pp.1440-1448, 2015.
22 J. R. Uijlings, K. E. van de Sande, T. Gevers, and A. W. Smeulders, "Selective search for object recognition," International Journal of Computer Vision (IJCV), pp.154-171, 2013.
23 P. Viola and M. Jones "Robust Real-time Face Detection," International Journal of Computer Vision, Vol.57, No.2, 2004.
24 N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: A simple way to prevent neural networks from overfitting," JMLR, pp.1929-1958, 2014.
25 Md. M. K. Sarker, "License Plate Detection Using Cascade Adaboost and Heuristic Energy Map," Master's degree thesis, Chonbuk National University, 2013.
26 Moon Yong Jin, Jong Bin Park, Dongsuk Lee, Dong Sun Park, "Real-Time Vehicle License Plate Recognition System Using Adaptive Heuristic Segmentation Algorithm," in KIPS Tr. Software and Data Eng., Vol.3, No.9, pp.361-368, 2014.   DOI
27 He, K., Zhang, X., Ren, S., and J. Sun, "Deep residual learning for image recognition," in CVPR, 2016.