Browse > Article
http://dx.doi.org/10.9711/KTAJ.2017.19.6.915

Development of a deep-learning based tunnel incident detection system on CCTVs  

Shin, Hyu-Soung (Extreme Construction Research Center, Korea Institute of Civil Engineering and Building Technology)
Lee, Kyu-Beom (Geotechnical Engineering Research Institute, Korea Institute of Civil Engineering and Building Technology Integrated Master's and Doctoral Degree Course, Geo-space Engineering Department, University of Science & Technology)
Yim, Min-Jin (Geotechnical Engineering Research Institute, Korea Institute of Civil Engineering and Building Technology)
Kim, Dong-Gyou (Geotechnical Engineering Research Institute, Korea Institute of Civil Engineering and Building Technology)
Publication Information
Journal of Korean Tunnelling and Underground Space Association / v.19, no.6, 2017 , pp. 915-936 More about this Journal
Abstract
In this study, current status of Korean hazard mitigation guideline for tunnel operation is summarized. It shows that requirement for CCTV installation has been gradually stricted and needs for tunnel incident detection system in conjunction with the CCTV in tunnels have been highly increased. Despite of this, it is noticed that mathematical algorithm based incident detection system, which are commonly applied in current tunnel operation, show very low detectable rates by less than 50%. The putative major reasons seem to be (1) very weak intensity of illumination (2) dust in tunnel (3) low installation height of CCTV to about 3.5 m, etc. Therefore, an attempt in this study is made to develop an deep-learning based tunnel incident detection system, which is relatively insensitive to very poor visibility conditions. Its theoretical background is given and validating investigation are undertaken focused on the moving vehicles and person out of vehicle in tunnel, which are the official major objects to be detected. Two scenarios are set up: (1) training and prediction in the same tunnel (2) training in a tunnel and prediction in the other tunnel. From the both cases, targeted object detection in prediction mode are achieved to detectable rate to higher than 80% in case of similar time period between training and prediction but it shows a bit low detectable rate to 40% when the prediction times are far from the training time without further training taking place. However, it is believed that the AI based system would be enhanced in its predictability automatically as further training are followed with accumulated CCTV BigData without any revision or calibration of the incident detection system.
Keywords
Automatic tunnel incident detection system; Deep learning algorithm; Tunnel CCTV; Image processing; Tunnel object image big data;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 Choi, J.M., Kwon, J.O. (2010), "Converged security market trend report", Samsung SDS, Samsung SDS Journal of IT Services, Vol.7, No. 2, pp. 13-29.
2 Everingham, M., Gool, L.V., Williams, C.K.I., Winn, J., Zisserman, A. (2010), "The pascal visual object classes (VOC) challenge", International Journal of Computer Vision, Vol. 88, No. 2, pp. 303-338.   DOI
3 Geiger, A., Lenz, P., Stiller, C., Urtasun, R. (2013), "Vision meets robotics: The KITTI dataset", The International Journal of Robotics Research, Vol. 32, No. 11, pp. 1231-1237.   DOI
4 Girshick, R., Donahue, J., Darrell, T., Malik, J. (2014), "Rich feature hierarchies for accurate object detection and semantic segmentation", The IEEE conference on Computer Vision and Pattern Recognition, pp. 580-587.
5 Girshick, R. (2015), "Fast R-CNN", The IEEE international conference on computer vision, pp. 1440-1448.
6 Hinton, G.E., Osindero, S., Teh, Y.W. (2006), "A fast learning algorithm for deep belief nets", Neural Computation, Vol. 18, No. 7, pp. 1527-1554.   DOI
7 Simonyan, K., Zisserman, A. (2014), "Very deep convolutional networks for large-scale image recognition", arXiv preprint, arXiv: 1409.1556.
8 Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., Fei-Fei, L. (2014), "Large-scale video classification with convolutional neural networks", The IEEE conference on Computer Vision and Pattern Recognition. pp. 1725-1732.
9 Kim, T.B. (2016), "The national highway, expressway tunnel video incident detection system performance analysis and reflect attributes for double deck tunnel in great depth underground space", Journal of the Korea Institute of Information and Communication Engineering, Vol. 20, No. 7, pp. 1325-1334.   DOI
10 Korea Tunneling and Underground Space Association (KTA) (2015), Study on revision of installation and operation guideline for hazard mitigation facilities of road tunnels, Ministry of Land Infrastructure and Transport (MOLIT), pp. 326.
11 Mu, Z. (2004), "Recall, precision and average precision", Working Paper, Department of Statistics and Actuarial Science, University of Waterloo, Vol. 2, pp. 30.
12 Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollar, P., Zitnick, C.L. (2014), "Microsoft coco: Common objects in context", European Conference on Computer Vision. Springer, Cham, pp. 740-755.
13 Ministry of Land, Infrastructure and Transport (MOLIT) (2016a), "Attempt for faultless safety system of road tunnels", Press Release.
14 Ministry of Land, Infrastructure and Transport (MOLIT) (2016b), Guideline of installation and management of disaster prevention facilities on road tunnels.
15 National Committee for Land and Transport (2016), "Tunnel accidents increase, but tunnel incident automatic detection system often fails in operation", Press Release from parliamentary inspection of MOLIT. Congressman Yoon Hoo-Dyuk.
16 Park, J.K., Park, Y.K., On, H.I., Kang, D.J. (2015), "Object perception methods in image using deep learning", Institute of Control, Robotics and Systems, Journal of Institute of Control, Robotics and Systems, Vol. 21, No. 4, pp. 21-26.   DOI
17 Ren, S., He, K., Girshick, R., Sun, J. (2015), "Faster R-CNN: Towards real-time object detection with region proposal networks", Advances in Neural Information Processing Systems 28, pp. 91-99.
18 Roh, C.G., Park, B.J., Kim, J.S. (2016), "A study on the contents for operation of tunnel management systems using a view synthesis technology", The Journal of the Korea Contents Association, Vol. 16, No. 6, pp. 507-515.   DOI
19 Shin, H.S., Kim, D.K., Yim, M.J., Lee, K.B., Oh, Y.S. (2017), "A preliminary study for development of an automatic incident detection system on CCTV in tunnels based on a machine learning algorithm", Journal of Korean Tunnelling and Underground Space Association, Vol. 19, No. 1, pp. 96-107.
20 Samuel, A.L. (1959), "Some studies in machine learning using the game of checkers", IBM Journal of Research and Development, Vol. 3, No. 3, pp. 210-229.   DOI
21 Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R. (2014), "Dropout: a simple way to prevent neural networks from overfitting", Journal of Machine Learning Research, Vol. 15, No. 1, pp. 1929-1958.
22 LeCun, Y., Boser, B.E., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W.E., Jackel, L.D. (1990), "Handwritten digit recognition with a back-propagation network", Advances in Neural Information Processing Systems, pp. 396-404.
23 LeCun, Y., Yoshua, B., Geoffrey, H. (2015), "Deep learning", Nature, Vol. 521, pp. 436-444.   DOI
24 Yoshua, B., Courville, A., Vincent, P. (2013), "Representation learning: a review and new perspectives", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 35, No. 8, pp. 1798-1828.   DOI