Browse > Article
http://dx.doi.org/10.5394/KINPR.2022.46.3.243

Real-time Wave Overtopping Detection and Measuring Wave Run-up Heights Based on Convolutional Neural Networks (CNN)  

Seong, Bo-Ram (Marine Information Technology Co.)
Cho, Wan-Hee (Marine Information Technology Co.)
Moon, Jong-Yoon (Marine Information Technology Co.)
Lee, Kwang-Ho (Department of Civil Engineering, Korea Maritime and Ocean University)
Abstract
The purpose of this study was to propose technology to detect the wave in the image in real-time, and calculate the height of the wave-overtopping through image analysis using artificial intelligence. It was confirmed that the proposed wave overtopping detection system proposed in this study could detect the occurring of wave overtopping, even in severe weather and at night in real-time. In particular, a filtering algorithm for determining if the wave overtopping event was used, to improve the accuracy of detecting the occurrence of wave overtopping, based on a convolutional neural networks to catch the wave overtopping in CCTV images in real-time. As a result, the accuracy of the wave overtopping detection through AP50 was reviewed as 59.6%, and the speed of the overtaking detection model was 70fps based on GPU, confirming that accuracy and speed are suitable for real-time wave overtopping detection.
Keywords
artificial intelligence; wave-overtopping detection; convolutional neural networks; filtering algorithm;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Goda, Y., Kishiara, Y. and Kamiyama, Y.(1975), "Laboratory Investigation on the Overtopping Rates for Seawalls by Irregular Waves", Port and Harbour Research Institution, Vol. 14, pp. 3-44.
2 Pullen, T., Allsop, N. W. H., Bruce, T., Kortenhaus, A., Schuttrumpf, H. and Van der Meer, J. W.(2007), EurOtop wave overtopping of sea defences and related structures: assessment manual.
3 Bochkovskiy, A., Wang, C. and Liao, H.(2020), "YOLOv4: Optimal Speed and Accuracy of Object Detection", arXiv preprint arXiv:2004.10934.
4 Chi, S., Zhang, C., Sui, T., Cao, Z., Zheng, J. and Fan, J.(2021). "Field observation of wave overtopping at sea dike using shore-based video images", Journal of Hydrodynamics, Vol. 33, pp. 57-672.
5 De Rouck J., Troch P., Van de Walle B., van Gent M., Van Damme L., De Ronde J., Frigaard P. and Murphy J.(2001), "Wave Run-up on Sloping Coastal Structures: Prototype Versus Scale Model Results", Proc. Int. Conf. on Coastlines, Structures and Breakwaters 2001, Institution of Civil Engineers, London, UK. 26-28 Sept. 2001.
6 De Rouck, J. Verhaeghe, H. and Geeraerts. J.(2009), "Crest level assessment of coastal structures-General overview", Coastal Engineering, Vol. 56, pp. 99-210.   DOI
7 Goda, Y.(2009), "Derivation of unified wave overtopping formulas for seawalls with smooth, impermeable surfaces based on selected CLASH datasets", Coastal Engineering, Vol. 56, pp. 385-399.   DOI
8 Ministry of Oceans and Fisheris(MOF).(2020), Korea Design Standrard (KC Code KDS 64 10 10).
9 LeCun, Y., Bottou, L., Bengio, Y. and Haffner, P.(1998), "Gradient-Based Learning Applied to Document Recognition", Proceedings of the IEEE, Vol. 86, pp. 2278-2324.   DOI
10 Lee, Y. H. and Kim, Y.(2020), "Comparison of CNN and YOLO for Object Detection", Journal of the Semiconductor & Display Technology, Vol. 19, No. 1, pp. 85-92.
11 MOIS, Ministry of the Interior and Safety. (2020). "Disaster Annual Report 2019", p. 431.
12 Liu, W., Anguelov, D., Erhan, D., Szegedy, S., Reed, S., Fu, C. and Berg, A.C.(2016), "SSD: Single Shot MultiBox Detector", European Conference on Computer Vision, Amsterdam, Netherlands, Oct. 8-16, pp. 21-37.
13 Redmon, J., Divvala, S., Girshick, R. and Farhadi, A.(2016), "You Only Look Once: Unified, RealTime Object Detection. Computer Vision and Pattern Recognition (CVPR)", 2016 IEEE Conference, pp. 779-788.
14 Redmon, J. and Farhadi, A.(2017), "YOLO9000: Better, Faster, Stronger", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7263-7271.
15 Redmon, J. and Farhadi, A.(2018), "YOLOv3: An Incremental Improvement", arXiv preprint arXiv:1804.02767.
16 Uijlings, J. R. R., Sande, K. E. A., Gevers, T. and Smeulders, A. W. M.(2013), "Selective Search for Object Recognition", International Journal of Computer Vision, Vol. 104, No. 2, pp. 154-171.   DOI
17 Choi, E. H. and Kim, C. S.(2012), "A Design of Disaster Prevention System and Detection of Wave Overtopping Number for Storm Surge base on CCTV", Journal of Korea Multimedia Soiety, Vol. 15, No. 2, pp. 258-265.   DOI
18 Girshick, R., Donahue, J., Darrell, T. and Malik, J.(2014), "Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation", IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA, pp. 580-587.
19 Haridas, R. and Jyothi, R. L.(2019), "Convolutional Neural Networks: A Comprehensive Survey", International Journal of Applied Engineering Research, Vol. 14, pp. 780-789.   DOI
20 Otsu, N.(1979), "A threshold selection method from gray-level histogram", IEEE Trans. on System Man Cybernetic, Vol. SMC-9, No. 1, pp. 62-66.   DOI
21 Van der Meer, J. W., Allsop, N. W. H., Bruce, T., De Rouck, J. Kortenhaus, A. Pullen, T., Schuttrumpf, H., Troch, P. and Zanuttigh, B.(2018), Manual on Wave Overtopping of Sea Defenses and Related Structures-An Overtopping Manual Largely Based on European Research, But for Worldwide Application.
22 Yoon, H. S., Park, J. H. and Jean, Y. H.(2017), "A Study on Wave Overtopping of the Seawall at Haeundae Marine City During the Passing of Typhoon Chaba", Journal of the Korean Society for Marine Environment and Energy, Vol. 20, No. 3, pp. 152-159.   DOI