Browse > Article
http://dx.doi.org/10.7848/ksgpc.2021.39.3.141

Detection of Zebra-crossing Areas Based on Deep Learning with Combination of SegNet and ResNet  

Liang, Han (Dept. of Civil Engineering, Kyungpook National University)
Seo, Suyoung (Dept. of Civil Engineering, Kyungpook National University)
Publication Information
Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography / v.39, no.3, 2021 , pp. 141-148 More about this Journal
Abstract
This paper presents a method to detect zebra-crossing using deep learning which combines SegNet and ResNet. For the blind, a safe crossing system is important to know exactly where the zebra-crossings are. Zebra-crossing detection by deep learning can be a good solution to this problem and robotic vision-based assistive technologies sprung up over the past few years, which focused on specific scene objects using monocular detectors. These traditional methods have achieved significant results with relatively long processing times, and enhanced the zebra-crossing perception to a large extent. However, running all detectors jointly incurs a long latency and becomes computationally prohibitive on wearable embedded systems. In this paper, we propose a model for fast and stable segmentation of zebra-crossing from captured images. The model is improved based on a combination of SegNet and ResNet and consists of three steps. First, the input image is subsampled to extract image features and the convolutional neural network of ResNet is modified to make it the new encoder. Second, through the SegNet original up-sampling network, the abstract features are restored to the original image size. Finally, the method classifies all pixels and calculates the accuracy of each pixel. The experimental results prove the efficiency of the modified semantic segmentation algorithm with a relatively high computing speed.
Keywords
Deep Learning; Semantic Segmentation; Zebra-crossing Detection; Neural Network;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Mascetti, S., Ahmetovic, D., Gerino, A., and Bernareggi, C. (2016), ZebraRecognizer: Pedestrian crossing recognition for people with visual impairment or blindness, Pattern Recognition, Vol. 60, pp. 405-419.   DOI
2 He, K., Zhang, X., Ren, S., and Sun, J. (2016), Deep residual learning for image recognition, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 27-30 June, Las Vegas, NV, USA, pp. 770-778.
3 Long, J., Shelhamer, E., and Darrell, T. (2015), Fully convolutional networks for semantic segmentation, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 15 October, Los Alamitos, CA, USA, pp. 3431-3440.
4 Roters, J., Jiang, X., and Rothaus, K. (2011), Recognition of traffic lights in live video streams on mobile devices, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 21, No. 10, pp. 1497-1511.   DOI
5 Taie, M.A., NasrEldin, K.M., and ElHelw, M. (2013), ITS navigation and live timetables for the blind based on RFID robotic localization algorithms and ZigBee broadcasting, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO), 12-14 December, Shenzhen, China, pp. 139-144.
6 Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017), Pyramid scene parsing network, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 21-26 July, Honolulu, HI, USA, pp. 6230-6239.
7 Zhai, Y., Cui, G., Gu, Q., and Kong, L. (2015), Crosswalk detection based on MSER and ERANSAC, 2015 IEEE 18th International Conference on Intelligent Transportation Systems, 15-18 September, Gran Canaria, Spain, pp. 2770-2775.
8 Yang, M., Shi, H., Chen, Y., Ran, X., and Xu, C. (2016), Zebra-crossing automatic recognition and early warning for intelligent driving, International Journal of Signal Processing, Image Processing and Pattern Recognition, Vol. 9, No. 8, pp. 263-274.   DOI
9 Badrinarayanan, V., Kendall, A., and Cipolla, R. (2017), SegNet: A deep convolutional encoder-decoder architecture for image segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 39, No. 12, pp. 2481-2495.   DOI
10 Zhong, J., Feng, W., Lei, Q., Le, S., Wei, X., Wang, Y., and Wang, W. (2020), Improved U-net for zebra-crossing image segmentation, 2020 IEEE 6th International Conference on Computer and Communications (ICCC), 12 February, Chengdu, China, pp. 388-393.
11 Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., and Yuille, A.L. (2018), DeepLab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 40, No. 4, pp. 834-848.   DOI
12 Fernandes, A.O., Moreira, L.F.E., and Mata, J.M. (2011), Machine vision applications and development aspects, 2011 9th IEEE International Conference on Control and Automation (ICCA). 19-21 December, Santiago, Chile, pp. 1274-1278.