Browse > Article
http://dx.doi.org/10.12989/sss.2021.28.6.811

Anomaly detection of isolating switch based on single shot multibox detector and improved frame differencing  

Duan, Yuanfeng (College of Civil Engineering and Architecture, Zhejiang University)
Zhu, Qi (College of Civil Engineering and Architecture, Zhejiang University)
Zhang, Hongmei (College of Civil Engineering and Architecture, Zhejiang University)
Wei, Wei (College of Civil Engineering and Architecture, Zhejiang University)
Yun, Chung Bang (College of Civil Engineering and Architecture, Zhejiang University)
Publication Information
Smart Structures and Systems / v.28, no.6, 2021 , pp. 811-825 More about this Journal
Abstract
High-voltage isolating switches play a paramount role in ensuring the safety of power supply systems. However, their exposure to outdoor environmental conditions may cause serious physical defects, which may result in great risk to power supply systems and society. Image processing-based methods have been used for anomaly detection. However, their accuracy is affected by numerous uncertainties due to manually extracted features, which makes the anomaly detection of isolating switches still challenging. In this paper, a vision-based anomaly detection method for isolating switches, which uses the rotational angle of the switch system for more accurate and direct anomaly detection with the help of deep learning (DL) and image processing methods (Single Shot Multibox Detector (SSD), improved frame differencing method, and Hough transform), is proposed. The SSD is a deep learning method for object classification and localization. In addition, an improved frame differencing method is introduced for better feature extraction and a hough transform method is adopted for rotational angle calculation. A number of experiments are conducted for anomaly detection of single and multiple switches using video frames. The results of the experiments demonstrate that the SSD outperforms the You-Only-Look-Once network. The effectiveness and robustness of the proposed method have been proven under various conditions, such as different illumination and camera locations using 96 videos from the experiments.
Keywords
anomaly detection; high voltage isolating switch; Hough Transform; improved frame differencing; object tracking; rotating angle; single shot multibox detector; vision-based method;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Simonyan, K. and Zisserman, A. (2014), "Very Deep Convolutional Networks for Large-Scale Image Recognition", Proceedings of 2015 International Conference on Learning Representations (ICLR), San Diego, CA, USA, May.
2 Wang, H., Xu, F., Jin, Y.Q. and Ouchi, K. (2009), "Estimation of bridge height over water from polarimetric sar image data using mapping and projection algorithm and de-orientation theory", IEICE Transact. Commun., 92(12), 3875-3882. https://doi.org/10.1587/transcom.E92.B.3875   DOI
3 Nassu, B.T., Lippmann, L., Marchesi, B., Canestraro, A. and Zarnicinski, V. (2018), "Image-based state recognition for disconnect switches in electric power distribution substations", Proceedings of the 31st Conference on Graphics, Patterns and Images (SIBGRAPI), Foz do Iguacu, Brazil, October.
4 Goodfellow, I., Bengio, Y. and Courville, A. (2016), Deep Learning, The MIT Press.
5 Guo, Y., Xu, Y. and Li, S. (2020), "Vision-based full-field panorama generation by UAV using GPS data and feature points filtering", Smart Struct. Syst., Int. J., 25(5), 631-641. https://doi.org/10.12989/sss.2020.25.5.631   DOI
6 Jun, K.S., Jae-Yeal, N. and Chul, K.B. (2018), "Online tracker optimization for multi-pedestrian tracking using a moving vehicle camera", IEEE Access, 6, 48675-48687. https://doi.org/10.1109/ACCESS.2018.2867621   DOI
7 Li, W.B., Chang, M.C. and Lyu, S. (2018), "Who did what at where and when: Simultaneous multi-person tracking and activity recognition", University at Albany, New York, NY, USA.
8 Liu, Y.Q., Zhan, F.Y., Jiang, X.W. and Zhou, H.Y. (2017), MATLAB: computer vision and deep learning combat.
9 Li, S., Guo, Y., Xu, Y. and Li, Z. (2019), "Real-time geometry identification of moving ships by computer vision techniques in bridge area", Smart Struct. Syst., Int. J., 23(4), 359-371. https://doi.org/10.12989/sss.2019.23.4.359   DOI
10 Redmon, J., Divvala, S., Girshick, R. and Farhadi, A. (2016), "You only look once: Unified, real-time object detection", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, June.
11 Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016), "SSD:Single shot multibox detector", Proceedings of European Conference on Computer Vision, Amsterdam, Netherlands, October.
12 Paul, N., Singh, A., Midya, A., Roy, P.P. and Dogra, D.P. (2017), "Moving object detection using modified temporal differencing and local fuzzy thresholding", J. Supercomput., 73, 1120-1139. https://doi.org/10.1007/s11227-016-1815-7   DOI
13 Li, M.H., Liu, Z.X., Xiong, Y.Y. and Li, Z. (2017), "Multi-person tracking by discriminative affinity model and hierarchical association", Proceedings of the 3rd IEEE International Conference on Computer and Communications (ICCC), Sichuan, China, December.
14 Mittal, S. (2013), "Object tracking using adaptive frame differencing and dynamic template matching method", Bachelor. Dissertation; National Institute of Technology Rourkela, Odisha, India.
15 Otsu, N. (1979), "A thresholding selection method from gray-level histogram", IEEE Trans.syst.man. & Cybern, 9(1), 62-66.   DOI
16 Serra, J. (1982), "Image analysis and mathematical morphology", Biometrics, 39(2), 536.
17 Shi, Y.H., Luo, Y., Tu, G.Y. and Wu, T. (2007), "An edge detectable algorithm for high-voltage isolating switch", Relay, 35(12), 23-26.   DOI
18 Ye, X.W., Dong, C.Z. and Liu, T. (2016), "Image-based structural dynamic displacement measurement using different multi-object tracking algorithms", Smart Struct. Syst., Int. J., 17(6), 935-956. https://doi.org/10.12989/sss.2016.17.6.935   DOI
19 Yu, C., Ding, X., Zhang, G. and Chen, M. (2017), "Observing Bridge Dynamic Deformation in Vibration by Digital Photography System", Proceedings of 2nd International Conference on Mechatronics and Information Technology.
20 Ran, N., Kong, L., Wang, Y.H. and Liu, Q.J. (2019), "A robust multi-athlete tracking algorithm by exploiting discriminant features and long-term dependencies", Proceedings of the 25th International Conference on Multimedia Modeling (MMM), Thessaloniki, Greece, January.
21 Siddiqui, Z.A., Park, U., Lee, S.-W., Jung, N.-J., Choi, M., Lim, C. and Seo, J.-H. (2018), "Robust powerline equipment inspection system based on a convolutional neural network", Sensors, 18(11), 3837. https://doi.org/10.3390/s18113837   DOI
22 Supreeth, H.S.G. and Patil, C.M. (2018), "Efficient multiple moving object detection and tracking using combined background subtraction and clustering", Signal Image and Video Processing, 12(6), 1097-1105. https://doi.org/10.1007/s11760-018-1259-z   DOI
23 Hough, V.P.C. (1962), Method and means for recognizing complex patterns.
24 Zhu, D., Feng, Y., Chen, Q. and Cai, J. (2010), "Image recognition technology in rotating machinery fault diagnosis based on artificial immune", Smart Struct. Syst., Int. J., 6(4), 389-403. https://doi.org/10.12989/sss.2010.6.4.389   DOI
25 Felzenszwalb, P., Girshick, R., McAllester, D. and Ramanan, D. (2010), "Object detection with discriminatively trained part based models", IEEE Transact. Pattern Anal. Mach. Intell., 32(9), 1627-1645. https://doi.org/10.1109/TPAMI.2009.167   DOI
26 Shafiee, M.J., Chywl, B., Li, F. and Wong, A. (2017), "Fast YOLO: A fast you only look once system for real-time embedded object detection in video", J. Computat. Vision Imag. Syst., 3(1).
27 Bouvy, R.J., Vincent, J., Parulski, K.A., Balch, K.S. and Erickson, G.L. (1995), "Progressive scan 30-frame-per-second megapixel camera", Proceedings of SPIE - The International Society for Optical Engineering, 2416, 30-36.
28 Duda, R.O. and Peter, E.H. (1972), "Use of the Hough transformation to detect lines and curves in pictures", Commun. ACM, 15(1), 11-15. https://doi.org/10.1145/361237.361242   DOI
29 Fei, M.J., Li, J. and Liu, H.H. (2015), "Visual tracking based on improved foreground detection and perceptual hashing", Neurocomputing, 152, 413-428. https://doi.org/10.1016/j.neucom.2014.09.060   DOI
30 Girshick, R. (2015), Fast R-CNN, Computer Science.
31 YOLOv5 (2020), https://github.com/ultralytics/yolov5. Ultralytics LLC, CA, USA.
32 Ren, S., He, K., Girshick, R. and Sun, J. (2015), "Faster R-CNN:Towards real-time object detection with region proposal networks", Proceedings of the 29th Annual Conference on Neural Information Processing Systems (NIPS), Montreal, Canada, December.
33 Lei, X.S. and Sui, Z.H. (2019), "Intelligent fault detection of high voltage line based on the Faster R-CNN", Measurement, 138, 379-385. https://doi.org/10.1016/j.measurement.2019.01.072   DOI
34 Tang, S., Andriluka, M., Andres, B. and Schiele, B. (2017), "Multiple person tracking by lifted multicut and person re-identification", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Puerto Rico, USA, June.
35 Wang, J., Liu, Q., Zhao, K., Yi, J. and Kai, P. (2017), "Recognition of high voltage isolating switch's states based on object tracking", Proceedings of 4th International Conference on Systems and Informatics (ICSAI), Zhejiang, China, November.
36 Mondal, T.G. and Jahanshahi, M.R. (2020), "Autonomous vision-based damage chronology for spatiotemporal condition assessment of civil infrastructure using unmanned aerial vehicle", Smart Struct. Syst., Int. J., 25(6), 733-749. https://doi.org/10.12989/sss.2020.25.6.733   DOI
37 Chen, A.W., Le, Q.M., Zhang, Z.Y. and Sun, Y. (2012), "Image recognition method for substation disconnecting switches state based on robots", Automat. Electric Power Syst., 6, 106-110.
38 Choi, J.W., Wangbo, T.K. and Kim, C.G. (2015), "A contour tracking method of large motion object using optical flow and active contour model", Multimedia Tools Applicat., 74(1), 199-210. https://doi.org/10.1007/s11042-013-1756-6   DOI
39 Wanyan, X.X., Fu, Q.C. and Xin, J. (2019), "Research on multi - target recognition of traction substation video based on transfer learning", Comput. Eng. Applicat., 55(24), 196-201.
40 Yin, X., Chen, W., Wu, X. and Yue, H. (2018), "Fine-tuning and visualization of convolutional neural networks", Proceedings of 2017 12th IEEE Conference on Industrial Electronics and Applications (ICIEA), IEEE.
41 Zhao, R., Shang, W., Wang T. and Zou, X. (2016), "State Evaluation of Isolating Switch in Transformer Substation Based on Image Processing", Comput. Measure. Control, 24, 241.
42 Zhao, D.W., Fu, H., Xiao, L., Wu, T. and Dai, B. (2018), "Multi-object tracking with correlation filter for autonomous vehicle", Sensors, 18(7), 2004. https://doi.org/10.3390/s18072004   DOI
43 Zoph, B., Cubuk, E.D., Ghiasi, G., Lin, T.Y., Shlens, J. and Le, Q.V. (2020), "Learning data augmentation strategies for object detection", Proceedings of European Conference on Computer Vision.
44 Geiger, A., Lenz, P., Stiller, C. and Urtasun, R. (2013), "Vision meets robotics: The kitti dataset", Int. J. Robot. Res., 32(11), 1231-1237. https://doi.org/10.1177/0278364913491297   DOI
45 Rahman, M.A. and Wang, Y. (2016), "Optimizing Intersection-Over-Union in Deep Neural Networks for Image Segmentation", Proceedings of the 12th International Symposium on Visual Computing (ISVC), Las Vegas, VA, USA, December.
46 Sharma, S., Ansari, J.A., Murthy, J.K. and Krishna, K.M. (2017), "Beyond pixels: Leveraging geometry and shape cues for online multi-object tracking", Proceedings of 2018 IEEE International Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, June.
47 Everingham, M., Eslami, S.M.A., Van Gool, L., Williams, C.K.I., Winn, J. and Zisserman, A. (2015), "The pascal visual object classes challenge: a retrospective", Int. J. Comput. Vis., 111(1), 98-136. https://doi.org/10.1007/s11263-014-0733-5   DOI
48 Fang, S., Shu, X.H. and Li, D.W. (2017), "A Method based on machine vision for opening-closing status recognition of substation disconnecting switches", J. Hunan Univ. Technol., 06, 1673-9833.